Blocked transaction restarted.

classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

Blocked transaction restarted.

macagua
Hola plonistas

He esta teniendo problemas con mi sistema Zeo, cuando ejecuto un cluster de Zope como 4 clientes Zeo con Filestorage, el archivo Data.fs es de 51 GB luego de la compactación cuyo tamaño original era de 101 GB.

Este log es generado por el zeo-server

tail -f var/log/zeoserver.log

2013-09-10T10:32:20 (56024) new connection ('127.0.0.1', 33661): <ManagedServerConnection ('127.0.0.1', 33661)>
2013-09-10T10:32:20 (127.0.0.1:33661) received handshake 'Z303'
2013-09-10T10:32:20 (56024) new connection ('127.0.0.1', 33662): <ManagedServerConnection ('127.0.0.1', 33662)>
2013-09-10T10:32:20 (127.0.0.1:33662) received handshake 'Z303'
2013-09-10T10:32:20 (56024) new connection ('127.0.0.1', 33663): <ManagedServerConnection ('127.0.0.1', 33663)>
2013-09-10T10:32:20 (127.0.0.1:33663) received handshake 'Z303'
2013-09-10T10:32:21 (56024) new connection ('127.0.0.1', 33667): <ManagedServerConnection ('127.0.0.1', 33667)>
2013-09-10T10:32:21 (127.0.0.1:33667) received handshake 'Z303'
2013-09-10T10:32:27 (56024/127.0.0.1:33662) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:27 (56024/127.0.0.1:33663) Blocked transaction restarted.
2013-09-10T10:32:27 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:27 (56024/127.0.0.1:33662) Transaction blocked waiting for storage. Clients waiting: 2.
2013-09-10T10:32:27 (56024/127.0.0.1:33663) Blocked transaction restarted.  Clients waiting: 1
2013-09-10T10:32:27 (56024/127.0.0.1:33661) Blocked transaction restarted.
2013-09-10T10:32:28 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:28 (56024/127.0.0.1:33663) Blocked transaction restarted.
2013-09-10T10:32:28 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:28 (56024/127.0.0.1:33663) Blocked transaction restarted.
2013-09-10T10:32:28 (56024/127.0.0.1:33662) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:28 (56024/127.0.0.1:33663) Blocked transaction restarted.
2013-09-10T10:32:29 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:29 (56024/127.0.0.1:33662) Blocked transaction restarted.
2013-09-10T10:32:30 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:30 (56024/127.0.0.1:33662) Blocked transaction restarted.
2013-09-10T10:32:30 (56024/127.0.0.1:33662) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:30 (56024/127.0.0.1:33661) Blocked transaction restarted.
2013-09-10T10:32:30 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:30 (56024/127.0.0.1:33662) Blocked transaction restarted.
2013-09-10T10:32:30 (56024/127.0.0.1:33662) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:30 (56024/127.0.0.1:33661) Blocked transaction restarted.
2013-09-10T10:32:31 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:31 (56024/127.0.0.1:33662) Blocked transaction restarted.
2013-09-10T10:33:14 (56024/127.0.0.1:33661) disconnected
2013-09-10T10:33:14 (56024/127.0.0.1:33663) disconnected
2013-09-10T10:33:14 (56024/127.0.0.1:33667) disconnected
2013-09-10T10:33:15 (56024/127.0.0.1:33662) disconnected

2013-09-10T10:14:30 (56024/127.0.0.1:59246) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:14:30 (56024/127.0.0.1:59241) Blocked transaction restarted.

Alguna idea???

--
Atentamente

T.S.U. Leonardo Caballero
Linux Counter ID = https://linuxcounter.net/user/369081.html
Key fingerprint = 9FD2 DC71 38E7 A1D1 57F5  1D29 04DE 43BC 8A27 424A

/me Corriendo Debian Wheezy y Canaina GNU/Linux 3
/me Cree "El Conocimiento Humano le Pertenece al Mundo"

_______________________________________________
Plone-ConoSur mailing list
[hidden email]
https://lists.plone.org/mailman/listinfo/plone-plone-conosur
Reply | Threaded
Open this post in threaded view
|

Re: Blocked transaction restarted.

Mikel Larreategi
2013/9/10 Leonardo Caballero <[hidden email]>
Hola plonistas

He esta teniendo problemas con mi sistema Zeo, cuando ejecuto un cluster de Zope como 4 clientes Zeo con Filestorage, el archivo Data.fs es de 51 GB luego de la compactación cuyo tamaño original era de 101 GB.

Este log es generado por el zeo-server

tail -f var/log/zeoserver.log

2013-09-10T10:32:20 (56024) new connection ('127.0.0.1', 33661): <ManagedServerConnection ('127.0.0.1', 33661)>
2013-09-10T10:32:20 (127.0.0.1:33661) received handshake 'Z303'
2013-09-10T10:32:20 (56024) new connection ('127.0.0.1', 33662): <ManagedServerConnection ('127.0.0.1', 33662)>
2013-09-10T10:32:20 (127.0.0.1:33662) received handshake 'Z303'
2013-09-10T10:32:20 (56024) new connection ('127.0.0.1', 33663): <ManagedServerConnection ('127.0.0.1', 33663)>
2013-09-10T10:32:20 (127.0.0.1:33663) received handshake 'Z303'
2013-09-10T10:32:21 (56024) new connection ('127.0.0.1', 33667): <ManagedServerConnection ('127.0.0.1', 33667)>
2013-09-10T10:32:21 (127.0.0.1:33667) received handshake 'Z303'
2013-09-10T10:32:27 (56024/127.0.0.1:33662) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:27 (56024/127.0.0.1:33663) Blocked transaction restarted.
2013-09-10T10:32:27 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:27 (56024/127.0.0.1:33662) Transaction blocked waiting for storage. Clients waiting: 2.
2013-09-10T10:32:27 (56024/127.0.0.1:33663) Blocked transaction restarted.  Clients waiting: 1
2013-09-10T10:32:27 (56024/127.0.0.1:33661) Blocked transaction restarted.
2013-09-10T10:32:28 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:28 (56024/127.0.0.1:33663) Blocked transaction restarted.
2013-09-10T10:32:28 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:28 (56024/127.0.0.1:33663) Blocked transaction restarted.
2013-09-10T10:32:28 (56024/127.0.0.1:33662) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:28 (56024/127.0.0.1:33663) Blocked transaction restarted.
2013-09-10T10:32:29 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:29 (56024/127.0.0.1:33662) Blocked transaction restarted.
2013-09-10T10:32:30 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:30 (56024/127.0.0.1:33662) Blocked transaction restarted.
2013-09-10T10:32:30 (56024/127.0.0.1:33662) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:30 (56024/127.0.0.1:33661) Blocked transaction restarted.
2013-09-10T10:32:30 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:30 (56024/127.0.0.1:33662) Blocked transaction restarted.
2013-09-10T10:32:30 (56024/127.0.0.1:33662) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:30 (56024/127.0.0.1:33661) Blocked transaction restarted.
2013-09-10T10:32:31 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:31 (56024/127.0.0.1:33662) Blocked transaction restarted.
2013-09-10T10:33:14 (56024/127.0.0.1:33661) disconnected
2013-09-10T10:33:14 (56024/127.0.0.1:33663) disconnected
2013-09-10T10:33:14 (56024/127.0.0.1:33667) disconnected
2013-09-10T10:33:15 (56024/127.0.0.1:33662) disconnected

2013-09-10T10:14:30 (56024/127.0.0.1:59246) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:14:30 (56024/127.0.0.1:59241) Blocked transaction restarted.

Alguna idea???


Demasiados clientes para el mismo servidor ZEO? Lo tienes todo en el mismo servidor?



Mikel

--
Mikel Larreategi
[hidden email]

CodeSyntax
Azitaingo Industrialdea 3 K
E-20600 Eibar
Tel: (+34) 943 82 17 80

_______________________________________________
Plone-ConoSur mailing list
[hidden email]
https://lists.plone.org/mailman/listinfo/plone-plone-conosur
Reply | Threaded
Open this post in threaded view
|

Re: [Usuarios Plone] Blocked transaction restarted.

macagua
Si Mikel los tengo en el mismo servidor

Si todos los 4 clientes zeo, el zeo server, haproxy, varnish y nginx en el mismo servidor, con dos 2 hijos por cada cliente zeo con 8 GB de memoria en el servidor 


2013/9/11 Mikel Larreategi <[hidden email]>
2013/9/10 Leonardo Caballero <[hidden email]>
Hola plonistas

He esta teniendo problemas con mi sistema Zeo, cuando ejecuto un cluster de Zope como 4 clientes Zeo con Filestorage, el archivo Data.fs es de 51 GB luego de la compactación cuyo tamaño original era de 101 GB.

Este log es generado por el zeo-server

tail -f var/log/zeoserver.log

2013-09-10T10:32:20 (56024) new connection ('127.0.0.1', 33661): <ManagedServerConnection ('127.0.0.1', 33661)>
2013-09-10T10:32:20 (127.0.0.1:33661) received handshake 'Z303'
2013-09-10T10:32:20 (56024) new connection ('127.0.0.1', 33662): <ManagedServerConnection ('127.0.0.1', 33662)>
2013-09-10T10:32:20 (127.0.0.1:33662) received handshake 'Z303'
2013-09-10T10:32:20 (56024) new connection ('127.0.0.1', 33663): <ManagedServerConnection ('127.0.0.1', 33663)>
2013-09-10T10:32:20 (127.0.0.1:33663) received handshake 'Z303'
2013-09-10T10:32:21 (56024) new connection ('127.0.0.1', 33667): <ManagedServerConnection ('127.0.0.1', 33667)>
2013-09-10T10:32:21 (127.0.0.1:33667) received handshake 'Z303'
2013-09-10T10:32:27 (56024/127.0.0.1:33662) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:27 (56024/127.0.0.1:33663) Blocked transaction restarted.
2013-09-10T10:32:27 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:27 (56024/127.0.0.1:33662) Transaction blocked waiting for storage. Clients waiting: 2.
2013-09-10T10:32:27 (56024/127.0.0.1:33663) Blocked transaction restarted.  Clients waiting: 1
2013-09-10T10:32:27 (56024/127.0.0.1:33661) Blocked transaction restarted.
2013-09-10T10:32:28 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:28 (56024/127.0.0.1:33663) Blocked transaction restarted.
2013-09-10T10:32:28 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:28 (56024/127.0.0.1:33663) Blocked transaction restarted.
2013-09-10T10:32:28 (56024/127.0.0.1:33662) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:28 (56024/127.0.0.1:33663) Blocked transaction restarted.
2013-09-10T10:32:29 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:29 (56024/127.0.0.1:33662) Blocked transaction restarted.
2013-09-10T10:32:30 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:30 (56024/127.0.0.1:33662) Blocked transaction restarted.
2013-09-10T10:32:30 (56024/127.0.0.1:33662) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:30 (56024/127.0.0.1:33661) Blocked transaction restarted.
2013-09-10T10:32:30 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:30 (56024/127.0.0.1:33662) Blocked transaction restarted.
2013-09-10T10:32:30 (56024/127.0.0.1:33662) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:30 (56024/127.0.0.1:33661) Blocked transaction restarted.
2013-09-10T10:32:31 (56024/127.0.0.1:33661) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:32:31 (56024/127.0.0.1:33662) Blocked transaction restarted.
2013-09-10T10:33:14 (56024/127.0.0.1:33661) disconnected
2013-09-10T10:33:14 (56024/127.0.0.1:33663) disconnected
2013-09-10T10:33:14 (56024/127.0.0.1:33667) disconnected
2013-09-10T10:33:15 (56024/127.0.0.1:33662) disconnected

2013-09-10T10:14:30 (56024/127.0.0.1:59246) Transaction blocked waiting for storage. Clients waiting: 1.
2013-09-10T10:14:30 (56024/127.0.0.1:59241) Blocked transaction restarted.

Alguna idea???


Demasiados clientes para el mismo servidor ZEO? Lo tienes todo en el mismo servidor?



Mikel

--
Mikel Larreategi
[hidden email]

CodeSyntax
Azitaingo Industrialdea 3 K
E-20600 Eibar
Tel: <a href="tel:%28%2B34%29%20943%2082%2017%2080" value="+34943821780" target="_blank">(+34) 943 82 17 80

_______________________________________________
Usuarios-Plone mailing list
[hidden email]
https://lists.plone.org/mailman/listinfo/plone-usuarios-plone




--
Atentamente

T.S.U. Leonardo Caballero
Linux Counter ID = https://linuxcounter.net/user/369081.html
Key fingerprint = 9FD2 DC71 38E7 A1D1 57F5  1D29 04DE 43BC 8A27 424A

/me Corriendo Debian Wheezy y Canaina GNU/Linux 3
/me Cree "El Conocimiento Humano le Pertenece al Mundo"

_______________________________________________
Plone-ConoSur mailing list
[hidden email]
https://lists.plone.org/mailman/listinfo/plone-plone-conosur
Reply | Threaded
Open this post in threaded view
|

Re: [Usuarios Plone] Blocked transaction restarted.

Mikel Larreategi
2013/9/11 Leonardo Caballero <[hidden email]>
Si Mikel los tengo en el mismo servidor

Si todos los 4 clientes zeo, el zeo server, haproxy, varnish y nginx en el mismo servidor, con dos 2 hijos por cada cliente zeo con 8 GB de memoria en el servidor 


Y cuántas CPUs? Lo digo porque igual no puede con todo.... Puedes hacer la prueba con 1 cliente zeo solo e ir aumentando los clientes y ver el comportamiento del sistema?

En HAProxy no ves si alguno de los clientes tiene algún cuello de botella?


Mikel



Mikel

--
Mikel Larreategi
[hidden email]

CodeSyntax
Azitaingo Industrialdea 3 K
E-20600 Eibar
Tel: (+34) 943 82 17 80

_______________________________________________
Plone-ConoSur mailing list
[hidden email]
https://lists.plone.org/mailman/listinfo/plone-plone-conosur
Reply | Threaded
Open this post in threaded view
|

Re: [Usuarios Plone] Blocked transaction restarted.

macagua

2013/9/11 Mikel Larreategi <[hidden email]>
2013/9/11 Leonardo Caballero <[hidden email]>
Si Mikel los tengo en el mismo servidor

Si todos los 4 clientes zeo, el zeo server, haproxy, varnish y nginx en el mismo servidor, con dos 2 hijos por cada cliente zeo con 8 GB de memoria en el servidor 


Y cuántas CPUs? Lo digo porque igual no puede con todo.... Puedes hacer la prueba con 1 cliente zeo solo e ir aumentando los clientes y ver el comportamiento del sistema?


Intel(R) Xeon(R) CPU E5-4617 0 @ 2.90GHz de 2 núcleos
 
Si voy hacer esas pruebas y te comento como me fue

En HAProxy no ves si alguno de los clientes tiene algún cuello de botella?



Hasta el momento de iniciar las 4 clientes zeo por las cantidad de pruebas hechas con 4 cuatro usuarios conectados solo las instance1 y instance4 atiende peticiones de cargas masivas las otras dos están sin consumir peticiones, las gráficas munin y los resultados de iotop, vmstat no arroja ningún wait o problemas de I/O ni de memoria o CPU
 
Con IOtop el máximo de proceso fue 45 % en picos de tarea 

Mikel



Gracias
 

Mikel

--
Mikel Larreategi
[hidden email]

CodeSyntax
Azitaingo Industrialdea 3 K
E-20600 Eibar
Tel: <a href="tel:%28%2B34%29%20943%2082%2017%2080" value="+34943821780" target="_blank">(+34) 943 82 17 80



--
Atentamente

T.S.U. Leonardo Caballero
Linux Counter ID = https://linuxcounter.net/user/369081.html
Key fingerprint = 9FD2 DC71 38E7 A1D1 57F5  1D29 04DE 43BC 8A27 424A

/me Corriendo Debian Wheezy y Canaina GNU/Linux 3
/me Cree "El Conocimiento Humano le Pertenece al Mundo"

_______________________________________________
Plone-ConoSur mailing list
[hidden email]
https://lists.plone.org/mailman/listinfo/plone-plone-conosur
Reply | Threaded
Open this post in threaded view
|

escanear archivos al subirlos a la web

mmartinezaa
CONTENTS DELETED
The author has deleted this message.
Reply | Threaded
Open this post in threaded view
|

Re: escanear archivos al subirlos a la web

Rubencho
Puede que ATClamAV(*) sea una buena guía.

(*) https://pypi.python.org/pypi/collective.ATClamAV


El 11 de septiembre de 2013 23:04, mai <[hidden email]> escribió:
Hola a todos,
Tengo un sitio Plone y quiero que al subir archivos (tipo File) en un contenedor (Folder) escanear y ver si está libre de virus y solo así subirlo. De qué manera pudiera hacer esto. O sea no me preocupa el cómo...supongo que lo haría en un evento al crear el objecto File. Lo que no se es cómo llamar al antivirus y si tengo que instalar algo en mi sitio.

gracias de antemano

_______________________________________________
Plone-ConoSur mailing list
[hidden email]
https://lists.plone.org/mailman/listinfo/plone-plone-conosur



_______________________________________________
Plone-ConoSur mailing list
[hidden email]
https://lists.plone.org/mailman/listinfo/plone-plone-conosur
Reply | Threaded
Open this post in threaded view
|

Re: escanear archivos al subirlos a la web

mmartinezaa
CONTENTS DELETED
The author has deleted this message.