Opened 3 years ago

Closed 3 years ago

Last modified 3 years ago

#11845 closed Bug/Something is broken (wontfix)

Website down

Reported by: Jennifer Tong Owned by: JaimeV
Priority: Urgent Component: Tech
Keywords: Cc: Jamie McClelland
Sensitive: no

Description

I believe our server is down (stone.mayfirst.org 209.51.180.237) - do you know when it will be able to be back up? We urgently need our website functioning.

Change History (4)

comment:1 Changed 3 years ago by JaimeV

Owner: set to JaimeV
Status: newassigned

checking now

comment:2 Changed 3 years ago by Jennifer Tong

Thanks - it seems to be back up. Appreciate anything you were able to do.

comment:3 Changed 3 years ago by JaimeV

Cc: Jamie McClelland added

The number of php processes for your site appeared to be saturated. I restarted the apache2 server and the php process manager and everything has come up again.

Examining your logs I see two ip numbers with a large amount of hits in the logs

0 stone:~# mf-web-hits-by-ip /home/members/jubilee/sites/jubileeusa.org/logs/web.log | tail -n2
  47685 209.51.180.237
  87343 88.198.180.41

The first of those is the server itself which would suggest there is some automated process driving the site to send requests to itself. Below with the following script I tried to see which URL was receiving the most requests.

0 stone:~# mf-web-hits-by-request /home/members/jubilee/sites/jubileeusa.org/logs/web.log | tail -n1
  47685 GET /index.php?id=259 209.51.180.237

The above http://www.jubileeusa.org/index.php?id=259 doesn't exist so that seems wrong.

Also I tried to find what requests the other ip 88.198.180.41 was responsible for. The requests for that ip are mostly unique however based on the requests it is trying to make there is either something wrong with the site or the web configuration as the crawler appears to be trapped in a loop...

Below is just a sample of the output of "grep 88.198.180.41 /home/members/jubilee/sites/jubileeusa.org/logs/web.log | awk '{print $7}' | sort -h | uniq -c"

      2 /de/press/press-item/article/de/press.html&print=1&no_cache=1
      2 /de/press/press-item/article/de/press.html&print=1&no_cache=1&print=1&no_cache=1
      2 /de/press/press-item/article/de/press.html&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1
      2 /de/press/press-item/article/de/press.html&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1
      2 /de/press/press-item/article/de/press.html&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1
      2 /de/press/press-item/article/de/press/nc/404.html?print=1
      2 /de/press/press-item/article/de/press/nc/nc/404.html?print=1
      2 /de/press/press-item/article/de/press/nc/nc/nc/404.html?print=1
      2 /de/press/press-item/article/de/press/press-contact-info.html
      2 /de/press/press-item/article/de/press/press-hits.html
      2 /de/press/press-item/article/de/press/press-item/article/argentina-debt-crisis-sets-dangerous-vulture-fund-precedent.html
      2 /de/press/press-item/article/de/press/press-item/article/congress-releases-draft-puerto-rico-bill-to-address-financial-crisis.html
      2 /de/press/press-item/article/de/press/press-item/article/congress-releases-draft-puerto-rico-bill-to-address-financial-crisis.html&print=1&no_cache=1
      2 /de/press/press-item/article/de/press/press-item/article/congress-releases-draft-puerto-rico-bill-to-address-financial-crisis.html&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1
      2 /de/press/press-item/article/de/press/press-item/article/congress-releases-draft-puerto-rico-bill-to-address-financial-crisis.html&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1
      2 /de/press/press-item/article/de/press/press-item/article/how-one-hedge-fund-made-2-billion-from-argentinas-economic-collapse.html
      2 /de/press/press-item/article/de/press/press-item/article/in-puerto-rican-debt-standoff-proof-of-the-rising-clout-of-minority-holdouts.html
      2 /de/press/press-item/article/de/press/press-item/article/nc/404.html?print=1
      2 /de/press/press-item/article/de/press/press-item/article/nc/nc/404.html?print=1
      2 /de/press/press-item/article/de/press/press-item/article/nc/nc/nc/404.html?print=1
      2 /de/press/press-item/article/de/press/press-item/article/porto-rico-lile-qui-vire-au-cauchemar.html
      2 /de/press/press-item/article/de/press/press-item/article/presidential-candidates-criticize-pfizer-merger.html
      2 /de/press/press-item/article/de/press/press-item/article/puerto-rico-expected-to-float-superbond-offer-in-private-meeting-today.html
      2 /de/press/press-item/article/de/press/press-item/article/puerto-rico-government-meets-with-debt-holders-in-new-york.html
      2 /de/press/press-item/article/de/press/press-item/article/puerto-rico-government-meets-with-debt-holders-in-new-york.html&print=1&no_cache=1
      2 /de/press/press-item/article/de/press/press-item/article/puerto-rico-government-meets-with-debt-holders-in-new-york.html&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1
      2 /de/press/press-item/article/de/press/press-item/article/white-house-acts-on-corruption-and-tax-evasion-in-wake-of-panama-papers.html
      2 /de/press/press-item/article/de/press/press-item/article/white-house-acts-on-corruption-and-tax-evasion-in-wake-of-panama-papers.html&print=1&no_cache=1
      2 /de/press/press-item/article/de/press/press-item/article/white-house-acts-on-corruption-and-tax-evasion-in-wake-of-panama-papers.html&print=1&no_cache=1&print=1&no_cache=1
      2 /de/press/press-item/article/de/press/press-item/article/white-house-acts-on-corruption-and-tax-evasion-in-wake-of-panama-papers.html&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1
      2 /de/press/press-item/article/de/press/press-item/article/white-house-acts-on-corruption-and-tax-evasion-in-wake-of-panama-papers.html&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1
      2 /de/press/press-item/article/de/press/press-item/article/white-house-acts-on-corruption-and-tax-evasion-in-wake-of-panama-papers.html&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1&print=1&no_cache=1

So that look REALLY off as well. I don't see any redirects or rewrites in your web configuration saved in the control panel but it seems there are some very complicated rules in the .htaccess file sabed in your web folder.

I think you should definitely have whoever has helped you develop your website take a look at all of this as soon as possible otherwise I suspect that whatever happened earlier today will occur again.

I'm also copying jamie here.

Last edited 3 years ago by JaimeV (previous) (diff)

comment:4 Changed 3 years ago by JaimeV

Resolution: wontfix
Status: assignedclosed

Also related to #11525 and #11889

Last edited 3 years ago by JaimeV (previous) (diff)

Please login to add comments to this ticket.

Note: See TracTickets for help on using tickets.