Opened 5 years ago

Last modified 5 years ago

#8474 assigned Bug/Something is broken

please help troubleshoot - lost drupal page

Reported by: https://id.mayfirst.org/icarus Owned by: https://id.mayfirst.org/ross
Priority: Urgent Component: Tech
Keywords: lost-content drupal Cc:
Sensitive: no

Description

French translation page

and

coming off meds page

http://www.theicarusproject.net/alternative-treatments/harm-reduction-guide-to-coming-off-psychiatric-drugs

suddenly disappear

we are concerned about security breach, or some plugin problem or something significant.

Can you look into the logs and tell us when those pages were deleted and under what circumstances?

thanks!

  • Will

Change History (15)

comment:1 Changed 5 years ago by https://id.mayfirst.org/icarus

sorry I have two tickets on this - i logged in as Icarus just so you can identify me for access

so I looked at

You should be able to review the logs at ​http://www.theicarusproject.net/admin/reports/dblog .

the logs - very helpful -

when i filter by content it only goes back two weeks of events? So If I want to see log items related to content I am only seeing to feb 2. It's like a pager is missing to show additional pages?

any help appreciated. This is the most trafficked page on the site that disappeared.

thanks - Will

comment:2 Changed 5 years ago by https://id.mayfirst.org/ross

  • Owner set to https://id.mayfirst.org/ross
  • Status changed from new to assigned

Hi Will,

There is a cronjob that controls how many watchdog (log) messages get stored. So if they only go back two weeks that's probably all you're going to get. Sorry, but that seems like the best we can do, b/c those additional logs have likely been deleted.

~/ross

comment:3 Changed 5 years ago by https://id.mayfirst.org/ross

  • Keywords lost-content drupal added
  • Sensitive unset

comment:4 Changed 5 years ago by https://id.mayfirst.org/icarus

Hi Ross

this is the single most trafficked page on the site, that has been live for more than 7 years. It just suddenly disappeared. Surely there is some way to do some kind of forensics on this, looking at apache logs and searching for mysql queries corresponding to the node id in drupal or something? We need to figure this out, it is pretty important, and any help you can offer greatly appreciated. and Is there any backup of the Icarus database and server we can look at to restore the page?

Also, how do we set the watchdog module log in drupal to say 6 mos? if it's just dumping a text file then keeping 6 mos not 2 weeks isn't going to eat any storage, bandwidth, or extra cpu or anything right? for future use.

thanks for help

comment:5 Changed 5 years ago by https://id.mayfirst.org/icarus

Anything you can do to help this situation really appreciated.

How to track down why a page in drupal was deleted...

comment:6 Changed 5 years ago by https://id.mayfirst.org/ross

Hi Will,

I don't know what to tell you, I don't have the ability to track the entire history of your site to determine what one of your users may have mistakenly done. Drupal certainly will not delete content by itself, but it does, in fact look like the node was deleted. Looking at the way-back-machine I see this which suggests the node id was 15035. That node id no longer exists in the database.

I think your only option is to reconstruct the page, here's the markup for the body of the page, if that's helpful:

    <p><a href="/web/20131207104149/http://theicarusproject.net/downloads/ComingOffDrugsGuideCOVERBIG.jpg"><img src="/web/20131207104149im_/http://www.theicarusproject.net/downloads/ComingOffDrugsGuideCOVER.jpg" alt="" align="left" hspace="10" /></a></p>
<p>The Icarus Project and Freedom Center's 40-page guide gathers the best information we've come across and the most valuable lessons we've learned about reducing and coming off psychiatric medication. Includes info on mood stabilizers, anti-psychotics, anti-depressants, anti-anxiety drugs, risks, benefits, wellness tools, psychiatric drug withdrawal, information for people staying on their medications, detailed Resource section, and much more. A 'harm reduction' approach means not being pro- or anti-medication, but supporting people to make their own decisions balancing the risks and benefits involved. Written by Will Hall, with a 53-member health professional Advisory Board providing research assistance and many other collaborators involved in developing and editing. The guide has photographs and art throughout, and a beautiful original cover painting by Jacks McNamara.</p>
<p>Download a .pdf to read below. It is also easy to use the printer version to print and fold into a booklet (instructions below) for yourself.</p>
<p>You can also print multiple copies to distribute, or send to a print shop for color copies and stapling.</p>
<p>Now in a revised and expanded Second Edition.</p>
<p>Note that the guide is Creative Commons copyright and you are free to copy and distribute for non-commercial purposes, as long as you credit the source and don't alter it.</p>
<p><strong><a href="/web/20131207104149/http://theicarusproject.net/downloads/ComingOffPsychDrugsHarmReductGuide1Edonline.pdf">Download and read the Guide.</a></strong>&nbsp;</p>
<p><strong><a href="/web/20131207104149/http://theicarusproject.net/downloads/ComingOffPsychDrugsHarmReductGuide1EdZinePrint.pdf">Download a printer version, with scrambled pages ready to fold.</a></strong></p>
<p><a href="/web/20131207104149/http://theicarusproject.net/downloads/ComingOffHarmReducGuideAssemblyInstructions.pdf">Download simple assembly instructions for the printer version.</a></p>
<p><a href="/web/20131207104149/http://theicarusproject.net/GuiaReducciondelDanoDiscontinuaciondeDrogasPsiquiatricas"><strong><em>Available in Spanish... Disponible en Castellano/ Espanol.</em></strong></a></p>
<p><a href="/web/20131207104149/http://theicarusproject.net/alternativetreatments/harmreductionguidegermantranslation-harmreduction-leitfadenzumrisikoarmenabsetzenvonpsychopharmaka" target="_blank"><strong><em>Also available in German.</em></strong></a></p>
<p><a href="/web/20131207104149/http://theicarusproject.net/alternative-treatments/harm-reduction-guide-greek-translation" target="_blank"><strong><em>Also available in Greek</em></strong></a></p>
<p><a href="/web/20131207104149/http://www.theicarusproject.net/advocacy-rights-politics/coming-off-medications-guide-bosnian" target="_blank"> <strong><em>Also available in Bosnia/Croatian</em></strong></a></p>
<p><a href="/web/20131207104149/http://www.theicarusproject.net/files/ComingOffGuidePromoSheet.pdf">Download a one-page flyer about the guide with ordering instructions.</a></p>
<p><a href="/web/20131207104149/http://theicarusproject.net/alternative-treatments/the-making-of-the-harm-reduction-guide-to-meds-withdrawal">Read about the making of the Guide.</a></p>
<p><a href="/web/20131207104149/http://www.madnessradio.net/audio-extra/09HearingVoicesCongress-WillHallComingOffMedications.mp3">Audio talk on Coming Off Medications from 2009 Hearing Voices Congress</a></p>
<p>Direct link this page:<br /> <a class="moz-txt-link-freetext" href="/web/20131207104149/http://www.theicarusproject.net/HarmReductionGuideComingOffPsychDrugs">http://theicarusproject.net/HarmReductionGuideComingOffPsychDrugs</a><a href="/web/20131207104149/http://theicarusproject.net/guiareducciondeldanodiscontinuaciondedrogaspsiquiatricas" target="_blank"><em><br /> </em></a></p>
<p><em>If you are looking for more information and support on psychiatric medication options including coming off / withdrawal, please see the </em><a href="/web/20131207104149/http://theicarusproject.net/forums/viewforum.php?f=64&sid=aff12b213b229419c4b5fe6d24430c4a" target="_blank"><em>Icarus coming off forums</em></a><em>, the website </em><a href="/web/20131207104149/http://bipolarblast.wordpress.com/" target="_blank"><em>Beyond Meds</em></a><em>, the UK website </em><em><a href="/web/20131207104149/http://www.comingoff.com/" target="_blank">ComingOff.com</a>, and <a href="/web/20131207104149/http://www.madnessradio.net/audio-extra/09HearingVoicesCongress-WillHallComingOffMedications.mp3" target="_blank">this audio on "Coming Off Medications"</a></em><em>.</em></p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p> 

You would need to disable your wysiwyg to add this markup.

As far as tracking down the point of deletion, I simply cannot find anything. I can tell you only that it does not seem as if it was done from the node edit page and instead from the /admin/content page, but I cannot tell you more than this.

~/ross

comment:7 Changed 5 years ago by https://id.mayfirst.org/icarus

Ross this is super helpful, thank you, the code will be helpful to reconstruct the page, and the node id could be helpful as well. That is interesting about the deletion from the admin/content page not the node/edit page, as it suggests I didn't make some simple stupid mistake when i was editing the page. If the node is gone from the database that is troubling as it suggests something deliberate.

as far as backups - how is icarus set up to do backups and is there a way to archive them so we can look to older databases to restore things? because it seems that this is a vulnerability the site has, if something gets deleted or lost or something, to be able to go back to previous databases would be really helpful. Let me know your advice as I'd like to put something in place that can prevent this from happening again

and also -- maybe give us some tools to look at and see what happens when something goes wrong? is there a way to configure logs so they are more comprehensive and reach back farther? The drupal log module only goes back two weeks. It has a lot of items but as a text file maybe having two months of logs wouldn't be that consuming?

Thanks again for your help and any advice you may have moving forward.

  • Will

comment:8 Changed 5 years ago by https://id.mayfirst.org/icarus

Ross --

starting to really panic here

Just discovered another page missing.

This one shows up in Google but 404's on the site

www.theicarusproject.net/articles/crash-course-in-urban-shamanism‎

can you help? any way to track down when/how this one was deleted?

comment:9 Changed 5 years ago by https://id.mayfirst.org/icarus

Ross can we please look into backups of the icarus project database from past?

that page is not on wayback machine. I don't have another copy to reconstruct it.

comment:10 Changed 5 years ago by https://id.mayfirst.org/ross

Hi Will,

I suspect the urban shamanism link is simply the wrong link. Is this the node you're looking for http://www.theicarusproject.net/node/254 ?

As far as backups go, we keep 5 days of backups of your data and make daily backups of your databases. However, as far as I can tell the icarus project does not have a quality database backup system in place. As part of my earlier analysis I looked for database backups that might help and did not find any.

I will go ahead and configure that for you if you would like, so in the future we'll have this data,

~/ross

comment:11 Changed 5 years ago by https://id.mayfirst.org/icarus

yes i overreacted, the shamanism node is fine, just things being momentarily weird not long term weird.

Yes, if you can configure a robust backup strategy for our databases that would be fantastic (drupal and our phpbb),.

a robust incremental backup for the server files that would also be fantastic, I can forsee something coming on this end too and better safe than sorry, though that's a lot of data compared to the databases, as an incremental backup it should be manageable and there's not a lot of large files involved I don't think.

I'm not much of a developer so I don't know what would be a best practices, but I do think that we should prepare for worst case scenarios and also not noticing something is wrong until weeks or longer later.

Let us know, this is /greatly/ appreciated. - Will

comment:12 Changed 5 years ago by https://id.mayfirst.org/ross

Hi Will,

Backing up the entire site and file structure is a bit more complicated than the database. I've gone ahead and created a backup system for your drupal database, which will get queued once a week. I added the phpbb database to that cronjob as well. All of the database backup files will be stored in ~/sql-backups.

I think the file structure is much more secure as it's much harder to accidentally delete a file than accidentally delete a node. Let me work out a solution for this. Please check back in with me at the beginning of next week.

~/ross

comment:13 Changed 5 years ago by https://id.mayfirst.org/icarus

great thank you ross. So how often are the backups and when are they done, so I have a sense of this? and that makes sense about the file structure.

comment:14 Changed 5 years ago by https://id.mayfirst.org/ross

I'm running the backups once a week, early Sunday morning. This should mean there will always be a good backup since there is a May First database backup done on a nightly basis and 5 days worth of backups as well. We should decide on a date past which the backups get deleted, since keeping database backups over long periods of time is excessively redundant, but that's not a huge priority at the moment.

comment:15 Changed 5 years ago by https://id.mayfirst.org/icarus

fabulous, thank you so much for this help Ross. - Will

Please login to add comments to this ticket.

Note: See TracTickets for help on using tickets.