== May First/People Link Technology Infrastructure == === The big picture === May First/People Link uses a file system/subversion repository as our database of servers. For information on how to access this information, please see our [wiki:server_overview server overview page]. Diagrams of our server layouts are available: * https://support.mayfirst.org/browser/trunk/admin/diagrams/telehouse.png Telehouse (NYC) * https://support.mayfirst.org/browser/trunk/admin/diagrams/xo.png XO (NYC) * https://support.mayfirst.org/browser/trunk/admin/diagrams/sunsetpark.png Sunset Park (Brooklyn) * https://support.mayfirst.org/browser/trunk/admin/diagrams/hostmysite.png Hosting.com (Delaware) * https://support.mayfirst.org/browser/trunk/admin/diagrams/avensys.png Avensys (UK) ==== Server Terminology ==== May First/People Link distinguishes between two types of servers: MOSH:: [wiki:MOSH]servers refer to any server running a predefined set of services including (http, imap, pop, smtp, submission). These servers are generally accessible by numerous members via ssh and provide multiple uses for members. PITS:: [wiki:PITS] are *not* MOSH servers. They are Physical, Internal, Transitional or Specialized. Members generally do not have direct shell access to these servers. === Operating system installation === * Before installing an OS on a MFPL server, please update [wiki:ip_allocation the ip allocation page] to indicate which IP address you are using. * If it's a .mayfirst.org domain please either add to the DNS entry in the May First/People Link mayfirst.org [https://members.mayfirst.org Member control panel] or [/newticket open a new ticket] requesting that change. If it will be receiving email, be sure to setup an MX record that points to itself with a time to live over 12 hours to avoid getting caught in [http://sorbs.net SORBS]. * [wiki:add_server_to_server_svn_db Add the server to our subversion server database]. * The next steps depend on what exactly you are installing * Common steps * [wiki:install_debian How to install Debian on all new physical servers] - These are the minimum steps that should be taken for all ''physical'' new servers that we purchase. * [wiki:install_debian_extras Common additional steps to take on all servers] - For most servers (physical or virtual), we will want to take these steps as well (encrypted disks, etc.). Pick and choose what makes sense. * [wiki:configure_new_server Configure standard hosting server] - If the server will be used as a standard hosting server, here are the steps to enable it. * Xen Servers * [wiki:install_debian_xen How to install Xen on a new physical servers] - These steps will make a physical server a Xen server, allowing us to place new virtual servers on it. * [wiki:install_xen_domU Install a domU server on a xen dom0] - How to add a virtual server to a Xen controlled server. * Vservers * [wiki:install_debian_vserver How to install vservers on a new physical servers] - These steps will make a physical server a vserver host, allowing us to place new virtual servers on it. * [wiki:install_vserver Install a vserver] - Add a new vserver to a vserver host. * KVM * [wiki:install_debian_kvm_manager How to install KVM manager] - These steps will install the software used to manage and create KVM instances. * [wiki:install_kvm Create a new kvm instance] - Add a kvm instance to a host. === KVM === * [wiki:qemu-monitor How do I access the qemu monitor for a given KVM guest?] === Networking === * [wiki:ip_allocation All IP's controlled by May First/People Link] - including the ones in our Telehouse rack and the ones from Speakeasy * [wiki:setup_dedicated_ip Assign dedicated IPs for members ] - If a member wants a dedicated IP for ssl reasons, these are the steps for making it happen * [wiki:configure-hp-pro-curve Configure an HP Procurve 2824 (J4903A)] === Emergency Access === * [wiki:procedure_during_server_crisis What steps should I take if a server acting in an usual way (services not responding, etc.)?] * [wiki:restart-failed-server How do I restart a failed virtual server?] * [wiki:skinny_elephants_recovery How do I reboot a crashed server via the serial console?] * [wiki:remotely_turn_on_or_off_server How do I remotely power on or power off a server?] * [wiki:telehouse_serial_access How do I connect to a Telehouse server via serial line?] * [wiki:xo_serial_access How do I connect to a Bandon/XO server via serial line?] * [wiki:sunsetpark_serial_access How do I connect to a Sunset Park server via serial line?] === Disk Management === * [wiki:install_debian#DrivepartioningDisksetup Disk partitioning] * [wiki:increasing_logical_volume_size How do I increase the disk size on a server with available space in the volume group?] * [wiki:extend-disk-on-kvm-guest How do I extend the disk space on a KVM guest?] === mysql === * [wiki:mysql_command_line_access How do I grant command line access to mysql on MF/PL servers?] === Red === * [wiki:pushing_changes_to_red How do I update the Red svn repository?] * [wiki:red-fix-hard-error How do I fix a hard error in Red?] * [wiki:red-add-site-wide-admin How do I add an administer to the control panel?] === Backup === * [wiki:backup-architecture How is the backup system designed?] * [wiki:grant_web_access_to_backup How do I grant a MFPL members web access to http://backup.mayfirst.org/] * [wiki:restore_from_backup How do I restore a file from the backup?] === Misc === * [wiki:running-operating-system-updates Running operating system updates] * [wiki:setup_awstats Awstats for members] - How to turn it on. * [wiki:apachesolr Setup apache Solr search for Drupal on a given host] * [wiki:server_pictures Pictures of the insides of our server] The beginning! * [wiki:mfpl_data_model What is MFPL's system for managing members and accounts?] * [wiki:add_serial_access_to_console_server How do I add a new user/serial port to the console server when we add a new server?] * [wiki:upgrade_horde How do I upgrade Horde?] * [wiki:surveys Dealing with online surveys at MF/PL] * [wiki:ssh_security_policy SSH security policy] * [wiki:setup_svn_on_allende How do I setup an SVN repository for a member on Allende?] * [wiki:setup_suexec_directory How do I setup an suExec Directory for a member?] * [wiki:add_special_dns_records How do I add special DNS records?] * [wiki:server_overview How many servers does MFPL manage? What do they all do?] * [wiki:transfer_site_between_servers How do I move a site from one server to another server?] * [wiki:delist_from_sorbs How do I delist our servers from sorbs?] * [wiki:obliterate_svn_file How do I remove a file from svn (and all it's revisions)?] * [wiki:pxeboot_from_leslie How do I do a network based installation from Telehouse?] * [wiki:pxeboot_from_naomi How do I do a network based installation from XO/Bandcon?] * [wiki:sunsetpark_speakeasy_modem_settings What are the modem settings for our Speakeasy DSL connection?] * [wiki:check_traffic_usage How do I check traffic usage for our colo centers?] * [wiki:trac-redact How do I redact a password or other private info in a ticket?] * [wiki:mailman-redact How do I redact private info from MF/PL mailman archives?] * [wiki:sending-service-advisories How do I send a service advisory?] * [wiki:allocate_new_ip_block How do I allocate a new IP block?] * [wiki:mosh-x509 How are x509 certificates managed on MOSH servers?] * [wiki:custom-mosh-domain Setting a custom MOSH domain] === Server-specific Notes === MF/PL sets up systems that work across servers as a rule, but in certain cases a server may need to strike out on its own for a time with technology approaches that are not yet standardized. This section is for recording these set-ups, which may become the standard approach of the future. * [wiki:boggs Boggs]