Opened 4 years ago

Last modified 4 years ago

#9686 assigned Bug/Something is broken

Website down

Reported by: https://id.mayfirst.org/workersliberty Owned by: https://id.mayfirst.org/jamie
Priority: Urgent Component: Tech
Keywords: albizu.mayfirst.org mysql Cc:
Sensitive: no

Description

www.workersliberty.org down with message:

Site off-line The site is currently not available due to technical problems. Please try again later. Thank you for your understanding.

If you are the maintainer of this site, please check your database settings in the settings.php file and ensure that your hosting provider's database server is running. For more help, see the handbook, or contact your hosting provider.

The mysqli error was: Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2).

As far as I can make out, none of our techies have done anything relevant on the site recently, or know anything about this.

Change History (3)

comment:1 follow-up: Changed 4 years ago by https://id.mayfirst.org/dkg

  • Keywords albizu.mayfirst.org mysql added

I found that the mysql service on albizu was down. I just restarted it, and http://www.workersliberty.org/ seems to be back up now.

looking in albizu:/var/log/daemon.log.1.gz, i can see that it tried to restart at 05:16:52 (America/New_York time), and failed due to:

Jun 18 05:16:56 albizu mysqld: 140618  5:16:56 InnoDB: Initializing buffer pool, size = 4.0G
Jun 18 05:16:56 albizu mysqld: InnoDB: mmap(4395630592 bytes) failed; errno 12
Jun 18 05:16:56 albizu mysqld: 140618  5:16:56 InnoDB: Completed initialization of buffer pool
Jun 18 05:16:56 albizu mysqld: 140618  5:16:56 InnoDB: Fatal error: cannot allocate memory for the buffer pool
Jun 18 05:16:56 albizu mysqld: 140618  5:16:56 [ERROR] Plugin 'InnoDB' init function returned error.
Jun 18 05:16:56 albizu mysqld: 140618  5:16:56 [ERROR] Plugin 'InnoDB' registration as a STORAGE ENGINE failed.
Jun 18 05:16:56 albizu mysqld: 140618  5:16:56 [ERROR] Unknown/unsupported storage engine: InnoDB
Jun 18 05:16:56 albizu mysqld: 140618  5:16:56 [ERROR] Aborting
Jun 18 05:16:56 albizu mysqld: 
Jun 18 05:16:56 albizu mysqld: 140618  5:16:56 [Note] /usr/sbin/mysqld: Shutdown complete
Jun 18 05:16:56 albizu mysqld: 
Jun 18 05:16:56 albizu mysqld_safe: mysqld from pid file /var/run/mysqld/mysqld.pid ended

Maybe someone else can look into what triggered the restart at 05:16 and why the pool allocation would have failed (is this just an oom issue?)

comment:2 Changed 4 years ago by https://id.mayfirst.org/dskallman

  • Owner set to https://id.mayfirst.org/jamie
  • Status changed from new to assigned

I am looping Jamie in, but I see the site is up again. Thanks dkg!

comment:3 in reply to: ↑ 1 Changed 4 years ago by https://id.mayfirst.org/jamie

Maybe someone else can look into what triggered the restart at 05:16 and why the pool allocation would have failed (is this just an oom issue?)

Looks like an oom issue:

0 albizu:~# zgrep oom-killer /var/log/syslog.1.gz 
Jun 18 05:16:37 albizu kernel: [9373401.325387] mysqld invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
0 albizu:~# 

Please login to add comments to this ticket.

Note: See TracTickets for help on using tickets.