Showing posts with label CORAL. Show all posts
Showing posts with label CORAL. Show all posts

Sunday, March 6, 2011

coral

rsync rsync.samba.org/

aptitude

For those of you who like a little more power behind your tools you will certainly appreciate the Aptitude front-end for the apt package management system. Aptitude is based on the ncurses computer termina
l library so you know it’s a pseudo-hybrid between console and gui. Aptitude has a powerful search
system as well as an outstanding ncurses-based menu system that allows you to move around selections with the tab key and the arrow keys.

dselect

dselect is one of the primary user interfaces for managing packages on 
a Debian system.   At  the  dselect  main
      menu, the system administrator can:
       - Update the list of available package versions,
       - View the status of installed and available packages,
       - Alter package selections and manage dependencies,
       - Install new packages or upgrade to newer versions.

uname -a 

logout 

df -h

/dev/sda2  /
/dev/sda7  /scratch
/dev/sda5  /user
/dev/sda6  /var

less
Less is a program similar to more (1), but which allows backward movement in the file as well as forward movement. Also, less does not have to read the entire input file before starting, so with large input files
it starts up faster than text editors like vi (1). Less uses termcap (or terminfo on some systems), so it can run on a variety of terminals. There is even limited support for hardcopy terminals. (On a hardcopy terminal, lines which should be printed at the top of the screen are prefixed with a caret.)
less xorg.conf

Ubuntu LTS long term support

ssh polyps p3 

beluga p1

sudo shutdown -h now

agpgart-serverworks can not determine aperture size

open science grid
*********************************************************************
The df command is used to show the amount of disk space that is free on file systems. In the examples, df is first called with no arguments. This default action is to display used and free file space in blocks. In this particular case, th block size is 1024 bytes as is indicated in the output.
The first column show the name of the disk partition as it appears in the /dev directory. Subsequent columns show total space, blocks allocated and blocks available. The capacity column indicates the amount used as a percentage of total file system capacity.
The final column show the mount point of the file system. This is the directory where the file system is mounted within the file system tree. Note that the root partition will always show a mount point of /. Other file systems can be mounted in any directory of a previously mounted file system. In the example, there are two other file systems, the first in mounted as /home and the second is mounted as /p4.
In the second example, df is invoked with the -i option. This option instructs df to display information about inodes rather that file blocks. Even though you think of directory entries as pointers to files, they are just a convenience for humans. An inode is what the Linux file system uses to identify each file. When a file system is created (using the mkfs command), the file system is created with a fixed number of inodes. If all these inodes become used, a file system cannot store any more files even though there may be free disk space. The df -i command can be used to check for such a problem.
The df command allows you to select which file systems to display. See the man page for details on this capability.
www.linuxjournal.com/article/2747
****************************************************************************

fdisk -l

NAME

fdisk - Partition table manipulator for Linux

SYNOPSIS

fdisk [-u] [-b sectorsize] [-C cyls] [-H heads] [-S sects] device fdisk -l [-u] [device ...]
fdisk -s partition ...
fdisk -v

DESCRIPTION

Hard disks can be divided into one or more logical disks called partitions. This division is described in the partition table found in sector 0 of the disk. In the BSD world one talks about `disk slices' and a `disklabel'.
Linux needs at least one partition, namely for its root file system. It can use swap files and/or swap partitions, but the latter are more efficient. So, usually one will want a second Linux partition dedicated as swap partition. On Intel compatible hardware, the BIOS that boots the system can often only access the first 1024 cylinders of the disk. For this reason people with large disks often create a third partition, just a few MB large, typically mounted on /boot, to store the kernel image and a few auxiliary files needed at boot time, so as to make sure that this stuff is accessible to the BIOS. There may be reasons of security, ease of administration and backup, or testing, to use more than the minimum number of partitions.

**********************************************************
 /etc/init.d/gdm stop

/etc/init.d/gdm start


NIS & NFS & AFS

The Network Information Service or NIS (originally called Yellow Pages or YP) consists of a client–server directory service protocol for distributing system configuration data such as user and host names between computers on a computer network. Sun Microsystems developed the NIS and licenses this technology to virtually all other Unix vendors.
Network File System (NFS) is a network file system protocol originally developed by Sun Microsystems in 1984,[1] allowing a user on a client computer to access files over a network in a manner similar to how local storage is accessed. NFS, like many other protocols, builds on the Open Network Computing Remote Procedure Call (ONC RPC) system. The Network File System is an open standard defined in RFCs, allowing anyone to implement the protocol.
The Andrew File System (AFS) is a distributed networked file system which uses a set of trusted servers to present a homogeneous, location-transparent file name space to all the client workstations. It was developed by Carnegie Mellon University as part of the Andrew Project.[when?] It is named after Andrew Carnegie and Andrew Mellon. Its primary use is in distributed computing.

coral these days

最近几天终于把ubuntu LTS(long term version) 10.4 给机子安装完毕
然后把要点总结一下

1. 通过df -h 查看分区, 查看mount point 和 分区大小
2. 两个primary partition, \  , swap, 其余都是logical partitions
3. 安装NIS和NFS
NIS:
首先安装nis,
dpkg-reconfigure nis
Enter Domainname as: fishy.domain

Edit /etc/hosts to include: <server-ip-address> server-name
128.180.35.235 shark.ie.lehigh.edu shark

Edit /etc/adduser.conf to change to: FIRST_UID=6000
so that new uids on the client dont conflict with nis-ids.
Edit /etc/passwd to add as the last line:
+::::::
Edit /etc/group to add as the last line:
+:::
Edit /etc/shadow to add as the last line:
+::::::::
Do ypcat passwd so see if nis is functional.
2. NFS

First move /home directory to something like /localhome. Make necessary changes in /etc/passwd so that locally created users are not affected.

在/passwd这个文件中修改 beluga的路径, 将/home改成 /localhome
Edit /etc/auto.master to include:
/home /etc/auto.home --timeout=600

Edit /etc/auto.home to include:
* -rw,intr,hard,tcp shark.ie.lehigh.edu:/home/&
Now do umount /home. And then, /etc/init.d/autofs start
用apt-get install安装autofs
service autofs start /stop
tip:
apt-get remove nfs-common
apt-get install nfs-common
fstab -> file system table
shark.ie.lehigh.edu:/home  /home nfs rw, intr, hard, tcp 0 0
which means mount from shark.ie.lehigh.edu:/home to /home in the current file system
下一步就是要安装软件AFS

coral software installation

1. 首先先安装 AFS

Debian provides a way in which modules can be compiled from source and installed as Debian Packages (like RPMs) automatically, without manual compilation, editing of configuration files etc. Here is a summary of how to do this:
  1. apt-get install openafs-client module-assistant.
  2. module-assistant update
  3. module-assistant prepare openafs-modules
  4. module-assistant auto-build openafs-modules
  5. This will download the source files and compile modules for the kernel to make debian packages which can then be installed using dpkg.
  6. The configurations files are same, but are located in /etc/openafs instead of /usr/vice/
  7. Fedora doesnt seem to have a process of automating the compilation of modules for the kernel. Switch to Debian now

Installation is complete. Now we will configure the client to access AFS directories provided by Lehigh.

Edit /usr/vice/etc/CellServDB?

It should only have:

>cc.lehigh.edu #lehigh university
  1. 128.180.39.25           #fs2.cc.lehigh.edu
        128.180.2.13            #fs3.cc.lehigh.edu
        128.180.2.10            #fs4.cc.lehigh.edu
        128.180.2.11            #fs5.cc.lehigh.edu
  2. vi /usr/vice/etc/ThisCell
    It should only have one line:
    cc.lehigh.edu
  3. see that you have directory /afs. It should have been created when we installed openafs RPMs.
  4. To start the client do
    /etc/init.d/openafs-client start
**********************************************************************************************************************************

上面都是网上coral wiki里面的内容

下面是一些其他内容 

1. 在afs中 只有 cc.lehigh.edu 这一个文件夹

2. kernel 的版本 i386_linux26

3. usr/ local/bin ln -s /afs/cc.lehigh.edu/com/i386_linux26/

4. cd cc.lehigh.edu/common/i386_linux26/mathematics

5. exim4 mailserver

6. ilm is the liscense manager

7. can not resolve trout hostname
solution: emacs hostname  -> trout.ie.lehigh.edu

8. rsync -a barrucuda.ie.lehigh.edu: /usr/local/ilm ......

9. rsync -a shark.ie.lehigh.edu:~/.ssh/*

10. bash.bashrc 和 .bashrc 区别, bash.bashrc是系统文件, 
.bashrc是每一个user login 之后才更新的

11. option solver cplex12

12. /usr/local/cplex/21/bin/x86-.....

13. 别忘加path和export文件路径

wordexpress@coral

coral.ie.lehigh.edu/newcoral/seminar/wp-login

admin

welcome****


srv/www/newcoral/wp-content/files/coralseminar

how to copy one folder from one direc to another direc

cp -R [from dirctory] [to directory]

coral condor prep

1. install the condor from aptitude

2. in the condor_config file
change condor_host=shark.ie.lehigh.edu
sudo dpkg --purge condor

3. sudo updatedbd ( update database)

locate condor_config

4. /etc/init.d/condor restart

5 scp shark.ie.lehigh.edu: .......

coral update

1. touch

    Change file access and modification time.
2. you can rsync all the folders to the place using :, :, :, :,
3. to do a ubuntu upgrade on the command line:
  do-release-upgrade
4. ssh add root to dolphin.
               .ssh
5. to invoke gurobi
we need to type gurobi.sh.

Coral Update

1. osg: open science grid

2. Tiger auditing report
http://www.nongnu.org/tiger/

3. root /.ssh/known_hosts
.grbd

4. rsync

5. piranha and stingray are all 64 bits

6. rc.local
goto-line

7.  .htaccess

************************************************************************************

Wednesday, March 2, 2011

Installing the Coral new server

Today it is my first time to enjoy the installation of a computer cluster. Based on the configurations. I guess we bought

Six-Core AMD Opteron Processor+ AMD SR56x0 / SP5100 Chipset-based Solutions


http://www.supermicro.com/SR5690_SP5100/AMD_SR5690_SP5100.cfm?pg=SS
It is quite heavy and I almost can not bear it.


http://www.supermicro.com/Aplus/system/2U/2021/AS-2021A-32R_F.cfm

Eventually, we figured it out and made it right on the rack.