CSCF Application Server (Asimov) notes

Ubuntu OS

  • *We are running Ubuntu 10.04 LTS
  • I have added service and chkconfig to Ubuntu - borrowed from fedora

Feature Summary - high level

  • Ubuntu Linux OS
  • Software and CD installation repository shared on the network using SAMBA
    • 202 CD's, Windows and Linux, that can be installed over the network
      • CD's are in RAW ISO format - easy to burn
      • CD's ram images are also mounted online so they are all available
    • Common Windows Applications and License Keys
  • SAMBA server - see CSApplicationServer#File_Shares
  • System Imager - see SystemImager
  • Machine image repository - GHOST images of fully installed machines
    • See ImageDeploymentGhost
    • ie "Syspreped" Windows machine with Applications fully configured/patched and/or fully setup Linux images
      • Most images are created and maintained by the CORE infrastructure group - Phil Beldowski
  • Has private NAT firewalled network - VLAN 420
    • DHCP with local name server - See PXE server
    • PXE tftpboot functions - See PXE server
      • Boot DOS and Linux repair and imaging utilities or Linux network installers
    • DNS name server for NAT - See PXE server
    • SAMBA file shares
    • SSH and SSHFS - we can ssh mount resources
    • NFS file shares
    • APACHE Web service
      • Many of the SAMBA shares can be accessed here as http://asimov:8080/exports or /iso
      • DHCP reporting tool for private network activity
  • External network
    • SAMBA file shares - to all of UofW
    • SSH and SSHFS - we can ssh mount resources
    • NFS file shares - limited networks
    • APACHE Web service

Image deployment over the network from ASIMOV

Drive and File System

ANY changes to drive layout should also be updated, see: SMART Disk Monitoring configuration section
  • /dev/sda1 on / Root FS
  • /dev/sdf1 on /images Export and Software Images
  • /dev/sdc1 on /images2 Backup and Scratch
  • /dev/sdg1 on /images_backup Export and Software Images - BACKUP
  • /dev/sdb1 on /images2_backup Backup and Scratch - BACKUP
  • /dev/sde1 on /coregroup1 Coregroup
  • /dev/sdd1 on /coregroup2 Coregroup - BACKUP

SMART Disk Monitoring

  • Config: /etc/smartd.conf, /etc/default/smartmontools
  • Email Reports: /etc/sysconfig/MAIL_ALERT

File Shares

  • To see a list of shares you can run
    • NET VIEW command from a command prompt in Windows, for example, NET VIEW \\ASIMOV
    • smbclient -L asimov.cscf -U cscf-adm from Linux (provided by the smbclient package in Ubuntu).

root@asimov:~/dnsmasq# smbclient -L 192.168.1.1 -U cscf-adm
Enter cscf-adm's password: 
Domain=[CSCFSUPPORT] OS=[Unix] Server=[Samba 3.4.7]

   Sharename       Type      Comment
   ---------       ----      -------
   homes           Disk      Home Directories
   print$          Disk      Printer Drivers
   PXE             Disk      PXE Boot share for Network Book Images
   research        Disk      Research Share
   exports         Disk      ALL EXPORTS, Microsoft OS Dependent, Some site license software
   software        Disk      SOFTWARE not provided on CDROM images, Some licensed software
   install         Disk      Lawrence Folland - Research Group - work on file reorg.
   OFFICE10        Disk      Alias Office XP, network install, Note: needs license forms
   OFFICE11        Disk      Alias Office 2003, network install, Note: needs license forms
   vs.net2003      Disk      Alias VISUAL STUDIO NET 2003, Note: needs license forms
   vs.net2005      Disk      Alias VISUAL STUDIO NET 2005, Note: needs license forms
   iso             Disk      Mounted CDROM Images,Licensed Software, Requires License form IST
   rawiso          Disk      RAW ISO CDROM Images, Licensed Software, Requires License form IST
   backup          Disk      CSCF - RESEARCH USE - GENERAL TEMP BACKUP FOR ANY COMPUTER
   backups         Disk      CSCF - RESEARCH USE - CSCF STAFF COMPUTER BACKUP AREA
   backup2         Disk      CSCF - EVERYONE - BACKUP UNKNOWN or HACKED systems - userid backup
   sysprep         Disk      SYSPREP INSTALL IMAGES - Should move to IMAGES share
   nexus           Disk      STEVE NICKERSON - NEXUS
   nexus_adm       Disk      STEVE NICKERSON - NEXUS ADMIN
   drallen         Disk      Daniel Allen, Private, School of Computer Science - CSCF
   CORE            Disk      CORE GROUP
   CORE_MIRROR     Disk      Mirror of coregroup2 disk - read only - CORE and IMAGES
   IMAGES          Disk      Deployment images for all of CSCF
   IMAGES-BACKUP   Disk      Backup folder for new images
   CLAYTON         Disk      Clayton scratch area
   MAC             Disk      MAC software
   ADBACKUPS       Disk      AD Backups
   SUNDIAGS        Disk      SUN v40Z Diags share for logs
   PROJECTS        Disk      CSCF Projects
   IPC$            IPC       IPC Service (asimov server (Samba, Ubuntu))
   Xerox_DC2560A   Printer   Xerox 128
   PDF1            Printer   PDF1
   PDF             Printer   PDF
   lpc_dc2325      Printer   Colour Xerox Phaser
   lp_dc3507-monochrome Printer   Xerox Colour Printer in Monochrome mode
   lp_dc3507-colour Printer   Xerox Colour Printer in Colour Mode
   lp_db           Printer   HP 9000 series with duplexer
   lp_cscf-private Printer   HP LaserJet 4200
   lp7_cs          Printer   HP 8150
   lp2_dc3507      Printer   HP4000
   ljp_plg         Printer   ljp_plg
   ljp_maple       Printer   HP4100 in SCG Lab
   ljp_3016        Printer   Main Math Printers
   lj_dc3624       Printer   lj_dc3624
   LJ_DC2514       Printer   Pascal Poupart - HP2605DTN
   lj_dc2326       Printer   HP 1320 Printer
   lj_dc2319       Printer   HP LASER JET 1320
   lj_dc2306       Printer   AI group printer
   lj_dc2305       Printer   Bulk printing on 8.5x11 paper by SCICOM faculty, grads, and staff
   lj_csgrad       Printer   lj_csgrad
   lj_cs-special   Printer   Used for Envelope printing
   lj_cs           Printer   Main CS Research Print Queue
   HP_Color_LaserJet_2605dtn Printer   Pascal Poupart
   cscf-adm   Disk      Home Directories
Domain=[CSCFSUPPORT] OS=[Unix] Server=[Samba 3.4.7]

   Server               Comment
   ---------            -------
   ASIMOV               asimov server (Samba, Ubuntu)

   Workgroup            Master
   ---------            -------
   CSCFSUPPORT          

Common Sources

Source files are located in three directories

Common System Services

Notes System services can be controlled with the service command which is a script that simply invokes command in /etc/init.d . Each script has standard options such as start, stop, restart, status
  • mount_cds - mounts /iso images created from /images/rawiso
  • samba - samba service
  • apache2 - Web Server
  • dnsmasq - - Local Name server,DHCP server,PXE server * See DNSMASQ for details * See PXE server
  • firewall NatMasqFirewallExample
  • tftpboot structure See PXEBootFilesExample
  • Examples
    • service mount_cds stop - removes /iso
    • service mount_cds start - creates /iso loopback mounts from /images/rawiso

List Changed Configuration files

  • debsums -ec 2>/dev/null
       debsums -ec 2>/dev/null 
       /etc/apache2/sites-available/default
       /etc/apache2/ports.conf
       /etc/apcupsd/apcupsd.conf
       /etc/init.d/apcupsd
       /etc/default/apcupsd
       /etc/crontab
       /etc/cups/cupsd.conf
       /etc/default/debsums
       /etc/denyhosts.conf
       /etc/dnsmasq.conf
       /etc/e2fsck.conf
       /etc/fai/fai.conf
       /etc/fai/make-fai-nfsroot.conf
       /etc/fai/apt/sources.list
       /etc/qt3/qt_plugins_3.3rc
       /etc/manpath.config
       /etc/mercurial/hgrc.d/hgext.rc
       /etc/rpc
       /etc/default/nfs-common
       /etc/exports
       /etc/default/nfs-kernel-server
       /etc/ntp.conf
       /etc/ssh/ssh_config
       /etc/sysctl.conf
       /etc/smartd.conf
       /etc/default/smartmontools
       /etc/systemimager/getimage.exclude
       /etc/systemimager/rsync_stubs/10header
       /etc/systemimager/systemimager.conf
       /etc/systemimager/bittorrent.conf
       /etc/vsftpd.conf
       /etc/default/xinetd
       

Modifying service run levels

  • update-rc.d
  • old method
    • chkconfig -help
    • Notes* chkconfig uses comment tags in service files located in /etc/init.d

System Config Files and Utilities

Important system config files

  • File List /home/cscf-adm/scripts/save.list
  • Notes see comment in this file for descriptions

Samba

  • Config /etc/samba/smb.conf
  • Service /etc/inetd.d/samba

Backups and Mirroring

  • Script directory /home/cscf-adm/scripts
  • Documents /home/cscf-adm/scripts/README.TXT
  • Dependencies /etc/crontab - see comments

Local system utilities

  • Source directory /home/cscf-adm/src/src
  • Documents /home/cscf-adm/src/README.TXT

Firewall

  • Directory /home/cscf-adm/scripts/remote
  • Documents /home/cscf-adm/scripts/remote/README.TXT
  • Service etc/inetd.d/iptables - calls /home/cscf-adm/scripts/remote/firewall

Network

  • Configuration Files
    • /etc/sysconfig/
    • /etc/network/
    • /etc/hostname
    • /etc/hosts
    • /etc/resolv.conf

Name Server

  • Configuration Files

APC UPS

Note: currently disabled
  • Config: /etc/apcupsd/apcupsd.conf

Web Server

Web Server Utils

  • Source Directory /home/cscf-adm/src.web
  • Public Directory /home/cscf-adm/public_html

Httpd server update

  • On our server we include /etc/httpd/conf/local.conf from /etc/httpd/conf/httpd.conf for all local settings
Example /etc/httpd/conf/local.conf - permit access to iso images
Alias /iso "/iso"
<Directory /iso>
    order deny,allow
    deny from all
    allow from all
    Options All
</Directory>
  • Restart web server: service httpd restart
  • Restart mounted iso images: service mount_cds restart

PXE Server

  • DNSMASQ Configuration files /root/dnsmasq - See DNSMASQ
  • Home directory /tftpboot/pxes is the PXE root - see PXEBootFilesExample
  • Firewall NAT MASQ private network - see CF/NatMasqFirewallExample
  • See ~/readme.txt for up to date detailed file and directory descriptions

Adding PXE image to the CS Application Server

Notes Outlines how to setup a PXE boot environment for a new system

Installing PXE boot image

/tftpboot/pxes

/tftpboot/pxes/pxelinux.cfg/dos_menu

PXE related Applications and Documents

Hardware update research 16 Oct 2014

Asimov provides the following services

  • Private network nat and firewall for VLAN 420 DNS and DHCP server
  • File storage /image server for research and infrastructure
    • For all research and infrastructure Grad desktop images (new and past)
    • Software repository - well over 260 CD/DVD images of installation media
    • VMware images
    • Nexus images
    • Windows Server images for CS
  • CS CAD drawings
  • Documentation repository
  • Site license repository
  • Temporary backup space for machines undergoing repair and re-installation
  • Deploy studio repository for Macs
  • Special projects
  • PXE boot server with
    • Live Ubuntu images
    • RIP recovery tools
    • Diagnostic and disk wipe utils
    • All Ubuntu netboot installers - all version
    • Acronis images of machines (see file server)
  • Common installation scripts used by research and infrastructure in deploying machines "ubuntu-scripts"

Asimov CSCF Infrastructure Uses:

  • DHCP/NAT/Firewall/Network utility server for vlan 420
  • PC Imaging in DC (SE Lab, School Pool Laptops and Workstations, RSG workstations/loaner laptops.etc)
  • PC Image storage/archival
  • PC Image creation/prep (ubuntu-scripts)
  • PC PXE Boot Utilities (DBAN, Acronis.etc)
  • ISO/Application storage/archival (iso/rawiso/exports) (at least 300 or so current ISOs)
  • License storage (site_licenses.txt)
  • Macintosh DeployStudio repository for devonshire.cscf (imaging admin workstations, diagnosing Macs.etc)
  • Macintosh image storage/archival
  • Macintosh package storage/archival

Asimov's current problems/limitations

  • Imaging performance
    • Network/Disk speed is too slow for imaging multiple machines (one machine on our current core image may take upwards of a few hours to complete)
      • Available RAM also plays a factor in this
    • Macs imaging over DeployStudio seem to have speed and timeout issues when transferring large images such as Ed's undergrad image (about 80GB)
  • Storage Space
    • We like to backup machines that come in for service before making changes and before redeploying them (incase of future issues) but lack of space means we can't do this for most machine
    • We currently have to store backups on an external USB RAID box due to lack of available drive bays
    • When making new images, we have to shuffle a lot of files around due to the lack of a RAID setup
  • Reliability/Expandability
    • Current 'server' has only one desktop power supply installed (one point of failure)
    • No LOM (have to manage console over the remote KVM)
    • No free drive bays for future expansion

Hardware Requirements

  • Large hardware RAID in RAID 60 w/ battery backup on controller
    • At least 10TB of usable storage with room for expansion
    • At least 8 drives required, extras configured as hot spares
  • 10G SFP+ connection to both vlan 420 and vlan 15
  • 16GB+ of RAM
  • Redundant hotswap power supplies
  • LOM interface
  • Hardware warranty
  • Ubuntu 14.04.1 LTS server
Topic attachments
I Attachment Action Size Date Who Comment
Unknown file formatEXT acronis_menu manage 0.7 K 2011-12-09 - 13:07 MikeGore  
Unknown file formatEXT add_ghost manage 6.2 K 2011-12-09 - 13:11 MikeGore  
Unknown file formatEXT default manage 2.3 K 2011-12-09 - 13:07 MikeGore  
Unknown file formatEXT dos_menu manage 0.5 K 2011-12-09 - 13:08 MikeGore  
Unknown file formatconf menu.conf manage 3.7 K 2011-12-09 - 13:13 MikeGore  
Unknown file formatEXT mk_ubuntu manage 2.8 K 2011-12-09 - 13:11 MikeGore  
Unknown file formatEXT rip_menu manage 0.5 K 2011-12-09 - 13:08 MikeGore  
Topic revision: r52 - 2014-10-22 - DevonMerner
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2015 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback

escort ankara escort beylikduzu escort istanbul escort eskisehir escort bursa