Changes between Version 1 and Version 4 of Ticket #7521

Jul 4, 2013, 4:43:11 PM (8 years ago)


  • Ticket #7521

    • Property Keywords samba added
    • Property Owner set to Ross
    • Property Status changed from new to assigned
  • Ticket #7521 – Description

    v1 v4  
    1 Having finally procured the needed materials, I am ready to configure my file server. In addition to serving as the central resource for local home LAN using samba, I plan on using it to seed torrents and serve files via FTP.
     1Backing up a little...
    3 My plan is to use 2 4TB drives (non-raid) for storing the media/data files.
     3Over the years I have accumulated TBs of files, text documents, audios, videos, photos. Currently it is 'decentralized', on numerous computers (primarily windows OS), external hard drives, CDs/DVDs, flash drives, even floppies, often duplicated perhaps multiple instances! It is unwieldy to say the least.
    5 What would be the best way to configure the partitions, assuming there would be a small boot partition then the rest encrypted? Where does swap fit in the mix?
     5Aside from being a resource to me personally, I put a small portion of my library online via torrents, the demand for which maxes out my 'meager' 2mb/s UL bandwidth, resulting in about 300 GB of files served per month. This is limited by the nature of most bittorrent clients, which can't handle seeding thousands of torrents. Once my files are organized, I envision making custom torrents for collections, so that within 1 torrent there may be a thousand topically related files. With that strategy, seeding 200 such torrents could make over 100,000 files available.
     7Another concern is media creation, primarily hidef video. Seems Apple's Final Cut Pro is the dominant ap for that. Pre-Intel PowerMacs are cost effective for this. There are also multiple windows based video/audio editing programs too. And maybe one day there will be comparable FLOSS aps for linux. Until then, having a linux file server to handle the media for such projects seems to be a good start, with samba being the inclusionary element to integrate windows and OSx workstations along with those running linux.
     9My personal fileserve project will serve as a testbed of sorts. I am working with an activist-artists collective whose focus is on performing and producing hiphop media (audio and video). We are discussing how to implement a creative media center to facilitate their projects. I work with miniDV tape cameras and also the newer compressed formats, but prefer capturing/recording in uncompressed or raw modes, which than later be edited and encoded with less conversion loss. That obviously will require LOTS of disk space.
     11So the basic outline is to build a LAN domain controller/file server that can accommodate the NAS needs of linux, windows and OSx workstations. Samba 4.0 looks good to me. WAN access to files, either through torrents or FTP might also be implemented on this server or another that is able to share the files on it.
     13That said...
     15Having finally procured the needed materials, I am ready to configure my file server.
     17My plan is to initially use 2 4TB drives (non-raid) for storing the media/data files. Once my current files are consolidated and de-duplicated, I am hoping 8TB will suffice to provide a little space for future media creation projects.
     19I have installed and configured debian several times for testing and learning but recognize I do not yet comprehend all of the dos and don'ts. I am in the process of playing with the basic configuration, using 2 80GB drives. The encryption process is time consuming. I can't imagine how many days it will take to initialize 2 4TB drives.
     21Every attempt I have made using the debian DVD installs disks has failed. Seems I can install from the CD but not from the DVDs. I haven't tried the v7.1 DVDs yet but trying earlier versions on different HW platforms never succeeded for me.
     23Given that the install process using huge drives with encryption is so time consuming, I'd like to make sure I am creating the right/best partition scheme, hence my verbose background/purpose details above.
     25What would be the best way to configure the partitions, assuming there would be a small boot partition then the rest encrypted ala mayfirst style? Where does swap fit in the mix?
     27I have reviewed [ the Mayfirst server configuration guide]. That focuses on most command line configuration, with very little explanation of how to use debian's graphical install options. I have worked with some command line but like the GUI. I am more than willing to make screenshots along the way to help create a GUI tutorial that documents the configuration process.
     29Eventually I'd like to use the ZFS file system as it appears to be the most advanced, most reliable. While debian kFreeBSD supports it, ZoL ([ ZFS on Linux]) is still a work in progress, not yet incorporated into the official distro package.
     31Where to begin?
     33What partitions are needed, desired?
     34Which partitions need to be primary?
     35What partitions need to be mirrored? (boot and OS?)
     36If encryption may be desired, can it be done at a later time? Or does that process clear all data and prep all the space for reloading the files?
     38My thought is not to RAID the data partitions, at least initially. I am not sure how many TB I will need for consolidation. (Whatever data is on these 2 drives will be backed up to either external drives or another (RAID6?) backup server.)