( LOG )

Apache mod_rewrite

2011-09-15T15:05:00.000-05:00

ifolder on RHEL6 (x86_64)

2011-08-30T12:55:00.007-05:00

Finally iFolder works on RHEL6:

1. download from http://origin-download.mono-project.com/archive/2.10.2/sources/:
gtk-sharp-2.12.10.tar.bz2
gnome-sharp-2.24.1.tar.bz2
gnome-desktop-sharp-2.24.0.tar.bz2
unzip and install them

2. install mono:
download RedHat:RHEL-6.repo from http://download.opensuse.org/repositories/RedHat:/RHEL-6/standard/ and put it in /etc/yum.repos.d/
yum search mono
since I'm using x86_64:
yum install -y mod_mono-addon.x86_64 mono-addon-basic.noarch mono-addon-data.x86_64 mono-addon-data-oracle.x86_64 mono-addon-data-postgresql.x86_64 mono-addon-data-sqlite.x86_64 mono-addon-debugger.x86_64 mono-addon-devel.x86_64 mono-addon-mvc.x86_64 mono-addon-wcf.x86_64 mono-addon-web.x86_64 mono-addon-winforms.x86_64 mono-addon-winfxcore.x86_64 monodoc-addon-core.x86_64 monotools-addon-server.noarch mono-addon-core.x86_64 mono-addon-extras.x86_64 mono-addon-ibm-data-db2.x86_64 mono-addon-libgdiplus0.x86_64 mono-addon-locale-extras.x86_64 mono-addon-nunit.x86_64 mono-addon-xsp.noarch
mono will be installed in /opt/novell/mono

3. download mono-log4net1.2-1.2.10-1.tar.bz2 from:
http://ftp.gwdg.de/pub/linux/sources.redhat.com/cygwinports/release-2/DotNET/log4net/mono-log4net1.2/
unzip it, you'll get log4net.dll and some others
copy them to /opt/novell/mono:
cp -r usr/lib/mono/log4net /opt/novell/mono/lib/mono/
cp -r usr/lib/mono/log4net/gac/* /opt/novell/mono/lib/mono/gac/
cp lib/pkgconfig/log4net.pc /usr/local/lib/pkgconfig/
vi /usr/local/lib/pkgconfig/log4net.pc, change last line to:
Libs: -r:/opt/novell/mono/lib/mono/log4net/log4net.dll

4. libfraim:
"Download GNU ball" from
http://flaim.svn.sourceforge.net/viewvc/flaim/trunk/flaim/
and
http://flaim.svn.sourceforge.net/viewvc/flaim/trunk/ftk/
unzip ftk
cd ftk; autoreconf -i; ./configure; make
unzip flaim
cd flaim; autoreconf -i; ./configure; make
Notice: not installed yet, just need to use the .o files
download libflaim-4.9.845.tar.gz (or libflaim_4.9.966.orig.tar.gz) from http://sourceforge.net/projects/flaim/files/stable/flaim/source/

unzip it
change line 1071 of src/fsysdata.cpp from
if( (FLMBOOL)Value1)
to:
if( (FLMBOOL)((FLMUINT)Value1))
then "make" with following configurations: (NOTICE: must with -fPIC, you may modify Makefile)
===============================================================================
SVN Revision.................... 966 (or 845)
Host Operating System Family.... linux
Top Directory................... /path/to/libflaim-4.9.966
Target Operating System Family.. linux
Target Processor Family......... x86
Target Word Size................ 64
Target Build Type............... release
Target Path..................... /path/to/libflaim-4.9.966/build/linux-x86-64/release
Toolkit Path.................... /path/to/libflaim-4.9.966/ftk
Install Prefix.................. /usr
Compiler........................ g++ -fPIC
Librarian....................... ar
Defines......................... FLM_64BIT N_PLAT_UNIX _LARGEFILE64_SOURCE _FILE_OFFSET_BITS=64 _REENTRANT
===============================================================================
obj files will be generated in:
build/linux-x86-64/release/lib64/static/obj/
remove these obj files, link those obj files (name with some prefix, you need to rename them) from package "flaim" and "ftk" here.
you may found nlm_entrypoint.o missing, no problem, libflaim will generate it.
"make" again to generate
shared/libflaim.so.4.1
static/libflaim.a
"make install" to copy them to /usr/lib64, also /usr/lib64/pkgconfig/libflaim.pc

5. ifolder and plugin:
download
ifolder3-enterprise.tar.gz from http://sourceforge.net/projects/ifolder/files/iFolder%20Server/3.8.0.3/11.1/
novell-ifolder-enterprise-plugins.tar.gz from http://sourceforge.net/projects/ifolder/files/iFolder%20Server%20Plugins/3.8.0.3/11.1/
unzip ifolder3-enterprise.tar.gz
./autogen.sh --prefix=/opt/novell/ifolder
make; (need the libflaim built above)
make install
(if you want to change something, unzip original tar ball again, "make clean" cause some errors)
unzip novell-ifolder-enterprise-plugins.tar.gz
./autogen.sh --prefix=/opt/novell/ifolder
make; make install

6. configure:
make sure your apache is installed and with SSL
if you need LDAP, make sure it works.
ln -s /etc/httpd /etc/apache
edit the scripts in /opt/novell/ifolder/bin/ to correct the path
simias-server-setup and follow the steps
ifolder-admin-setup and follow the steps
ifolder-web-setup and follow the steps
these 3 steps will generate 3 files in /etc/httpd/conf.d:
simias.conf
ifolder_admin.conf
ifolder_web.conf
you can simply combine them to 1 file or even you can put it in a vhost.
I use SSL, so I put them in ssl.conf, like this:

.....
.....
.....
# simias10:
Include /etc/httpd/conf.d/mod_mono.conf
Alias /simias10 "/opt/novell/ifolder/lib64/simias/web"
AddMonoApplications simias10 "/simias10:/opt/novell/ifolder/lib64/simias/web"
MonoSetEnv simias10 "SimiasRunAsServer=true;SimiasDataDir=/usr/ifolder/simias"

Options FollowSymLinks
RewriteEngine on
RedirectMatch ^(.*)\?(.*)$ $1?$2
MonoSetServerAlias simias10
SetHandler mono

# ifolder-admin
Include /etc/httpd/conf.d/mod_mono.conf
Alias /admin "/opt/novell/ifolder/lib64/simias/admin"
AddMonoApplications admin "/admin:/opt/novell/ifolder/lib64/simias/admin"

Options FollowSymLinks
RewriteEngine on
RedirectMatch ^(.*)\?(.*)$ $1?$2
MonoSetServerAlias admin
AddHandler mono asax aspx ascx asmx ashx log csv
DirectoryIndex Default.aspx index.html

# ifolder-web
Include /etc/httpd/conf.d/mod_mono.conf
Alias /ifolder "/opt/novell/ifolder/lib64/simias/webaccess"
AddMonoApplications ifolder "/ifolder:/opt/novell/ifolder/lib64/simias/webaccess"

Options FollowSymLinks
RewriteEngine on
RedirectMatch ^(.*)\?(.*)$ $1?$2
MonoSetServerAlias ifolder
AddHandler mono asax aspx ascx asmx ashx csv
DirectoryIndex Default.aspx index.html

Notice there are a RedirectMatch because ifolder webaccess has a problem of URL coding "?", sometime it's just %3F in the URL which cause "404 not found" error.

7. add following lines to the beginning of function "start()" in /etc/init.d/httpd
touch /tmp/mod_mono_dashboard_XXGLOBAL_1
chown apache.apache /tmp/mod_mono_dashboard_XXGLOBAL_1
chmod 600 /tmp/mod_mono_dashboard_XXGLOBAL_1
or you'll find owner of /tmp/mod_mono_dashboard_XXGLOBAL_1 is root, not apache.

8. service httpd restart
to test your server

9. if you are using LDAP, simias-server-setup will create 2 users for iFolder in your LDAP repo: ifolder admin and proxy (you can name what you want)

10. for windows client, download ifolder-windows.exe from http://sourceforge.net/projects/ifolder/files/iFolder%20Clients/3.8.0.3/ instead of kablink, or you'll find LDAP auth error even with correct password (ERROR Simias.OpenLdapProvider.User - Error:Invalid Credentials)

11. if you can access ifolder via web, but windows client can't connect, uninstall it, remove following directories:
APPDATA/Roaming/iFolder
APPDATA/Roaming/simias
APPDATA/local/simias
${program files}/ifolder
${program files (X86)}/ifolder
and re-install the windows client (from SF, not Kablink)

12. Some problem:
sometimes the webaccess and admin portal can't login, error: incorrect redirected.
try restart httpd and login later (after last session expired)

Comments will be added to this post if I found something missing here.
zfsu.709@gmail.com

NCAR gmeta data

2010-09-23T14:31:00.001-05:00

idt file.gmeta

ctrans -d ps.color file.gmeta > file.ps

vim statusline

2010-07-28T11:42:00.003-05:00

\&ff File format, e.g. unix, mac, dos.
%< truncation point
%t File name (as opposed to file path)
%b Value of byte under cursor.
%n buffer number
%f relative path to file
%m modified flag [+] (modified), [-] (unmodifiable) or nothing
%r readonly flag [RO]
%y filetype [ruby]
%= split point for left and right justification
%-35. width specification
%l current line number
%L number of lines in buffer
%c current column number
%V current virtual column number (-n), if different from %c
%P percentage through buffer
%) end of width specification

%y file type between braces (if defined)
%([%R%M]%) read-only, modified and modifiable flags between braces
%{'!'[&ff=='default_file_format']}
shows a '!' if the file format is not the platform
default
%{'$'[!&list]} shows a '*' if in list mode
%{'~'[&pm=='']} shows a '~' if in patchmode
(%{synIDattr(synID(line('.'),col('.'),0),'name')})
only for debug : display the current syntax item name
%= right-align following items
#%n buffer number
%l/%L,%c%V line number, total number of lines, and column number

set statusline=%<\ %n:%f\ %m%r%y%=%-35.(line:\ %l\ of\ %L,\ col:\ %c%V\ (%P)%)

hi User1 ctermbg=darkgray ctermfg=red guibg=darkgray guifg=red
hi User2 ctermbg=darkgray ctermfg=green guibg=green guifg=green
hi User3 ctermbg=darkgray ctermfg=darkgray guibg=green guifg=darkgray
hi User4 ctermbg=red ctermfg=green guibg=red guifg=green
hi User5 ctermbg=darkgray ctermfg=blue guibg=green guifg=blue
hi User6 ctermbg=darkgray ctermfg=cyan guibg=green guifg=cyan
set laststatus=2
"set statusline+=%-3.3n " buffer number
set statusline+=%1*\[%n\]\ \ " buffer number
set statusline+=%2*%t " file name
set statusline+=%h%4*%m%r%w " flags, use color User1
set statusline+=%3*\ \[ " [
set statusline+=%{strlen(&ft)?&ft:''}, " filetype
"set statusline+=%{&encoding}, " encoding
"set statusline+=%{&fileformat}, " file format
set statusline+=LastModified:%{strftime(\"%m/%d/%Y\ %H:%M\",getftime(expand(\"%:p\")))} " file format
set statusline+=\]%* " ]
set statusline+=%5*\ \[F1-Help,F2-DirTree,F3-Tags,F5-SyntaxOn,F8-SVNDiff,F9-TabClose,F10-TabNew,F11/F12-TabPrev/Next\]%* " help
set statusline+=%= " right align
set statusline+=%6*%-14.(%l/%L,%c%)%P%* " offset
hi statusline ctermfg=black ctermbg=blue gui=bold

vim tricks

2010-07-21T10:59:00.001-05:00

1. make auto-increase numbers in VIM:
let i=1|g/^/s//\=i/|let i=i+1

2. select all text between current { and }
va{

web-based project management ssytem (free)

2010-05-24T16:32:00.002-05:00

Mantis: http://www.mantisbt.org/
Dotproject: dotproject.net

1. PHP, MySQL
2. GNU license
3. bug tracking

cdo & nco

2010-05-24T10:56:00.003-05:00

cdo:
cdo selname,Var1,Var2,... infile outfile

cdo mergetime file1 file2 file3 outfile (better than writting .F code)

cdo -f nc input,r195x138 output.nc < style="font-weight: bold;" size="4">

nco:
ncea -v Var1,Var2,... input1.nc [input2.nc [...]] output.nc

ncea -v Var1,Var2,... input1.nc output.nc
to retrieve data

ncwa -a Times input.nc output.nc
to compute average on specified dimension (Times)

ncks -v Var1,Var2,... input.nc -b out.bin out.nc
to generate binary file (GrADS compatible, small endian)

ncbo --op_typ=- input1.nc input2.nc output.nc
(output = input1 - input2)

ncap -s 'Presuure=P+PB' -v input.nc output.nc
to generate Pressure=P+PB

ncks -d time,1,100 alb2000-2009.nc a.nc
to get time=1~100 of alb2000-2009.nc, write to a.nc

ncap -s 'TFLAG=TFLAG+int(TFLAG/1995151)' input.nc output.nc
set TFLAG = TFLAG + int(TFLAG/1995151)

say AORGAT, AORGBT, AORGPAT are float in aconc_1995.nc
ncap -v -s 'OC=AORGAT+AORGBT+1.167*AORGPAT' aconc_1995.nc OCOC_conc_1995.nc
then OC is double, while
ncap -v -s 'OC=AORGAT+AORGBT+1.167f*AORGPAT' aconc_1995.nc OCOC_conc_1995.nc
OC is float

ncatted -a SDATE,global,m,i,1995151 input.nc output.nc
set global attibute SDATE to integer 1995151

ncrcat -p /scratch/scratchdirs/shenjian/run/uom_caladv/ -v Times,RAINC,RAINNC wrfout_d01_1993-01-19_00:00:00 wrfout_d01_1993-01-20_00:00:00 -o 2days_RAIN.nc
combine

ncrcat 1992/wrfsst_d01.1992120100 1993/wrfsst* -o wrfsst_d01.1992Dec1993
combine 199212 and each month of 1993 to one file.

command line parameters in alias

2010-04-14T16:40:00.002-05:00

csh works:
alias check 'echo "checking \!^ ..."; tail -f \!^/rsl.error.0000'

Google public data

2010-03-17T16:47:00.000-05:00

vim

2010-03-17T16:20:00.000-05:00

:h!

:h 42

Core file

2010-03-04T09:10:00.001-06:00

1. strings core | pg

2. gdb exe_file --core=core_file
bt

3. totalview exe_file core_file

4. ddt

vimdiff / vi -d

2010-02-23T13:04:00.002-06:00

zo     // open
zc     // close
=      // re-indent

JabRef

2010-02-19T08:45:00.000-06:00

Cool

Run serial job simultaneously on Franklin

2009-11-24T17:12:00.002-06:00

#PBS -N TestJob
# PBS ...
# PBS -l mppwidth=12

aprun -n 1 ./exe1 &
aprun -n 1 ./exe2 &
aprun -n 1 ./exe3 &
wait

Notice: 3nodes, not 3 cores

if not exe file, but perl script:
#PBS -N TestJob
# PBS ...
# PBS -l mppwidth=12

module load dynamic_libs
aprun -a xt -n 1 ./exe1.pl &
aprun -a xt -n 1 ./exe2.pl &
aprun -a xt -n 1 ./exe3.pl &
wait

and in exe?.pl:
use
#!/usr/common/usg/dynamic_libs/usr/bin/perl
instead of
#!/usr/bin/perl

vim

2009-09-22T13:40:00.002-05:00

SHIFT + #: search current word backward

(mp)xlf90_r on CrayXT

2009-09-04T08:50:00.003-05:00

-compile without -qaliassize: failed, will generate a suggestion value of alias size.
- compile with -O3 failed.
- compile with -O3 and -qalias_size=(half of suggestion value): OK. It does speed up very much.
-

CrayPat

2009-08-21T16:44:00.003-05:00

1. module load xt-craypaton Bassi or Franklin 2. generate your own executable application, say: myapp 3.pat_build -g mpi,io,heap,mpi,system myappwill generate another executable myapp+pat 4. run myapp+pat instead of myapp as usual a .xf file will be generated 5.pat_report -f ap2 file.xf to generate a .ap2 file for Cray Apprentice2 for visualization.
pat_report -f txt file.xf to generate a txt reportpat_report -d flops file.xf to generate report about flops
...

IPM

2009-08-21T15:02:00.004-05:00

0. http://ipm-hpc.sourceforge.net/

1. module load ipm on bassi or franklin

2. re-link your application:
do not need to re-compile, just relink:
cc -o myapp *.o ${IPM}
while ${IPM} = "-L/path/to/ipm/lib -lipm"

3. run myapp as usual

4. at the stdout, IPM result will be printed:
##IPMv0.921###################################################################
# command : wrf.exe (completed)
# host : nid12485/x86_64_Linux mpi_tasks : 8 on 2 nodes
# start : 08/21/09/10:57:30 wallclock : 4539.421100 sec
# stop : 08/21/09/12:13:10 %comm : 10.63
# gbytes : 8.06523e+00 total gflop/sec : 2.26567e+00 total
#
##############################################################################
# region : * [ntasks] = 8
#
# [total] min max
# entries 8 1 1 1
# wallclock 36315 4539.37 4539.32 4539.42
# user 35444.7 4430.59 4413.02 4439.18
# system 859.646 107.456 100.282 123.58
# mpi 3859.77 482.471 294.117 675.177
# %comm 10.6285 6.47919 14.8739
# gflop/sec 2.26567 0.283209 0.271092 0.294211
# gbytes 8.06523 1.00815 0.982914 1.09162
#
# PAPI_FP_OPS 1.02848e+13 1.2856e+12 1.2306e+12 1.33555e+12
# PAPI_TOT_CYC 8.15253e+13 1.01907e+13 1.01463e+13 1.02067e+13
# PAPI_VEC_INS 2.08042e+13 2.60052e+12 2.46755e+12 2.71892e+12
# PAPI_TOT_INS 8.8216e+13 1.1027e+13 1.05669e+13 1.14112e+13
#
# [time] [calls] <%mpi> <%wall>
# MPI_Wait 3124.33 1.41164e+06 80.95 8.60
# MPI_Bcast 654.498 383328 16.96 1.80
# MPI_Gatherv 36.1984 146024 0.94 0.10
# MPI_Isend 23.4889 705820 0.61 0.06
# MPI_Irecv 10.4487 705820 0.27 0.03
# MPI_Scatterv 9.8853 1.41425e+06 0.26 0.03
# MPI_Gather 0.846143 154832 0.02 0.00
# MPI_Comm_rank 0.0615279 780352 0.00 0.00
# MPI_Comm_size 0.0118754 147184 0.00 0.00
############################################################################

Other performance test applications:
- IBM High Performance Computing Toolkit (IHPCT)
- CrayPat

VIM color

2009-08-17T09:04:00.005-05:00

in ~/.vimrc:

if &term =~ "xterm"
if has("terminfo")
set t_Co=8
set t_Sf=^[[3%p1%dm
set t_Sb=^[[4%p1%dm
else
set t_Co=8
set t_Sf=^[[3%dm
set t_Sb=^[[4%dm
endif
endif

where ^[ is actual ctrl-V + ESC

http://frexx.de/xterm-256-notes/

SVN+SSH --tunnel-user

2009-08-12T11:55:00.004-05:00

Assume:
1. server for SVN is A
2. remove client (Linux/Windows/...) is B, C, D
3. On server A, svn belongs to svn_group.svn_user, and privilege is 700 (so no other shell user can access)
4. On server A, svn repository is already created, say /path/to/repo/
4. user X,Y from Linux client B, user Z from windows client C

Steps:
1. on A, generate ssh key pair for different user X,Y,Z:
ssh-keygen -t rsa
will generate 2 files: say myfile and myfile.pub, myfile contains ssh private key, myfile.pub contains the public key.
(run this for every user, so everyone has a private key and a public key)

2. On A, cd ~svn_user/.ssh
edit file authorized_keys (make sure the privilege of .ssh/ is 700, .ssh/authorized_keys is 600)
put following lines:
command="/path/to/svnserve -r /path/to/repo -t --tunnel-user=X",no-port-forwarding,no-agent-forwarding,no-X11-forwarding,no-pty ssh-rsa KeyX svn_user@server
command="/path/to/svnserve -r /path/to//repo -t --tunnel-user=Y",no-port-forwarding,no-agent-forwarding,no-X11-forwarding,no-pty ssh-rsa KeyY svn_user@server
command="/path/to/svnserve -r /path/to//repo -t --tunnel-user=Z",no-port-forwarding,no-agent-forwarding,no-X11-forwarding,no-pty ssh-rsa KeyZ svn_user@server

here KeyX/Y/Z is the public keys
the "no-port-forwarding,no-agent-forwarding,no-X11-forwarding,no-pty" protect the system against ssh login.

3. on Linux client B:
put the private key file to .ssh/, say ~/.ssh/svn.pk
set environment vairable SVN_SSH to ssh -i ${HOME}/.ssh/svn/pk

4. svn co/ci/up/...

Sweet

2009-08-03T11:54:00.005-05:00

Screen-test

2009-07-15T14:04:00.002-05:00

Evil? or Angel?

2009-07-15T14:01:00.001-05:00

songs

2009-07-10T15:12:00.010-05:00

伍佰：挪威的森林
罗大佑：你的样子
谭咏麟：水中花
陈百强：一生何求

set Output mask in ArcGIS

2009-07-07T15:22:00.003-05:00

when doing IDW, set mask to the area:

increase/decrease number in VI

2009-06-16T15:49:00.002-05:00

ctrl-A: increase a number
ctrl-X: decrease a number

makefile

2009-06-12T16:54:00.003-05:00

modflags_cwrf:
define ModLXZ
define CalUCM
define LXZALB
define OroRad
define DoVAST
undef GenSWC
undef GasInp
define SzaInp
define OznInp
define CldInp
undef MOSAIC
define AerInp
define AmrInp
undef Amr_3D
define NotPPT
define HghtIn
define QsfcIn
define FunSat
define USESSOTXY
define USEPINPUT
define USETPOTEN
undef SmthTend
undef DoBucket

arch.postamble_new_v31:
FGREP = fgrep -iq
MODFLAGS = # blablabla
ARCHFLAGS = $(CORED) ......

config:
STR=`awk '{ sub(/define/, "-D",$0); sub(/undef/, "-U", $0); gsub(/ /, "", $0); print $0 }' modflags_cwrf `
STR=`echo $STR |sed 's/\n//g'`
awk -v STR="& $STR" '{ sub(/^MODFLAGS\ *=/, STR, $0); print $0 }' arch.postamble_new_v31 > arch.postamble_new_v31.tmp
mv arch.postamble_new_v31.tmp arch.postamble_new_v31
rm -f arch.postamble_new_v31.tmp
...

Another way:
arch.postamble_new_v31:
MODFLAGS = `sed 's/^\#.*//g; s/\ //g; s/define/-D/g; s/undef/-U/g' modflags_cwrf`

fortran SUM bug

2009-06-05T10:40:00.003-05:00

modeled(195*138, 43818)
s = sum(modeled(:, :)) -> 2097520 (wrong)

do i=1, 43818
s = s + sum(modeled(:, i))
enddo
write(*,*) s ! -> 4.1598252E+07 (correct)

Compiler: ifort (IFORT) 10.1 20080602
OS: Linux 2.6.18-92.1.10.el5_lustre.1.6.6smp-perfctr #2 SMP Wed Jan 7 17:52:07 CST 2009 x86_64 x86_64 x86_64 GNU/Linux

!$

2009-06-03T09:38:00.001-05:00

path of last command
cd /path/to/dir; vi !$/file;
equals to:
cd /path/to/dir/; vi /path/to/dir/file;

check them all

2009-05-31T12:17:00.001-05:00

at page: http://nadp.sws.uiuc.edu/nadpdata/editCustomList.asp:
using Firebug:
sitelist.cbAK01.checked=true;
sitelist.cbAK02.checked=true;
sitelist.cbAK03.checked=true;
...
sitelist.cbWY97.checked=true;
sitelist.cbWY98.checked=true;
sitelist.cbWY99.checked=true;

VIM search color

2009-05-28T14:14:00.002-05:00

in ~/.vimrc
hi Search cterm=none ctermbg=4 ctermfg=15
set hlsearch

Output redirection

2009-05-27T09:01:00.003-05:00

tcsh:
( ./exe > log ) >>&! error_log

.exe >&! log

man tcsh/man bash for detail

Change Linux prompt

2009-05-22T10:03:00.004-05:00

bash:
export PS1="\u@\h \w> "
\u loginname
\h hostname
\w full path of current dir
\! count number
\$? status of last command
\e[ beginning of color prompt
x;ym color, see below
\e[m end of color
\a an ASCII bell character (07)
\d the date in “Weekday Month Date” format (e.g., “Tue May 26″)
\D{format} - the format is passed to strftime(3) and the result is inserted into the prompt string; an empty format results in a locale-specific time representation. The braces are required
\e an ASCII escape character (033)
\h the hostname up to the first part
\H the hostname
\j the number of jobs currently managed by the shell
\l the basename of the shell’s terminal device name
\n newline
\r carriage return
\s the name of the shell, the basename of $0 (the portion following the final slash)
\t the current time in 24-hour HH:MM:SS format
\T the current time in 12-hour HH:MM:SS format
\@ the current time in 12-hour am/pm format
\A the current time in 24-hour HH:MM format
\u the username of the current user
\v the version of bash (e.g., 2.00)
\V the release of bash, version + patch level (e.g., 2.00.0)
\w the current working directory, with $HOME abbreviated with a tilde
\W the basename of the current working directory, with $HOME abbreviated with a tilde
\! the history number of this command
\# the command number of this command
\$ if the effective UID is 0, a #, otherwise a $
\nnn the character corresponding to the octal number nnn
\\ a backslash
\[ begin a sequence of non-printing characters, which could be used to embed a terminal control sequence into the prompt
\] end a sequence of non-printing character

Colors:
Black 0;30
Blue 0;34
Green 0;32
Cyan 0;36
Red 0;31
Purple 0;35
Brown 0;33

tcsh:
set prompt="%B[%n@%m]%b%/(%h)> "
%B begin bold font
%n loginname
%m hostname
%b end of bold font
%c current dir
%/ full path of current dir
%h count
%/ Displays the current working directory.
%h, %!, ! These codes all display the current history number.
%t, %@ These codes both display the time of day.
%n Displays the username.
%d Displays the current day of the week.
%w Displays the current month.
%y Displays the current year.

Redirect tty output

2009-05-19T16:34:00.000-05:00

( nohup exe_file [parameters] > & log_file ) &

stage

2009-05-19T13:50:00.002-05:00

stage: to retrieve files from tape to MSS disk.
All the "get" will transfer files from MSS disk to local disk, meaning all "get" need to stage first.

ls:
-rwxr--r-- 1 username ac common AR 281267 Apr 6 11:40 R2_CAS001.log.19950104
stage 0 file1 file2* file3? R2_CAS001.log.19950104
after a few minutes:
-rwxr--r-- 1 username ac common DK 281267 Apr 6 11:40 R2_CAS001.log.19950104

Fortran compile problem

2009-05-14T16:18:00.004-05:00

Error: relocation truncated to fit: R_X86_64_PC32 .bss
......

Solution:
1. add -mcmodel medium: does not work
2. add -i-dynamic: does not works
3. each file should be compiled with the same key compiling parameter:
$(FC) -convert big_endian -i-dynamic -mcmodel=large -c $(SRC)

VI: Search a word

2009-05-14T11:56:00.002-05:00

/\<word\>

VI indent

2009-05-14T09:35:00.001-05:00

ggVG, =
:set autoindent shiftwidth=4

Weather Station

2009-05-07T08:55:00.003-05:00

Payroll deduction

2009-05-06T16:02:00.001-05:00

State tax: 3%
FICA medicare: 1.45%
Old Age Survivor Disability Insurance: 6.2%
Federal tax: ??%

BTU

2009-05-05T11:45:00.002-05:00

the British Thermal Unit (BTU) is the international measurement of energy.
A Btu is the amount of heat required to raise one pound of water one degree Fahrenheit.
In AC jargon, Btu's measure the amount of heat an air conditioning unit can remove from the room.

Quarter

2009-05-05T10:14:00.005-05:00

http://www.netstate.com/states/quarters/index.html

HSI on Franklin

2009-05-05T10:02:00.001-05:00

somewhat like msscmd and mssftp:
http://www.nersc.gov/nusers/systems/hpss/usage_hsi.php

HSI documents @:http://www.mgleicher.us/GEL/hsi/

Notice:
put local_file : hpss_file
get local_file : hpss_file
need space around ":"

Perl file test operand

2009-04-28T13:43:00.002-05:00

File test Meaning
-r File or directory is readable by this (effective) user or group
-w File or directory is writable by this (effective) user or group
-x File or directory is executable by this (effective) user or group
-o File or directory is owned by this (effective) user
-R File or directory is readable by this real user or group
-W File or directory is writable by this real user or group
-X File or directory is executable by this real user or group
-O File or directory is owned by this real user
-e File or directory name exists
-z File exists and has zero size (always false for directories)
-s File or directory exists and has nonzero size (the value is the size in bytes)
-f Entry is a plain file
-d Entry is a directory
-l Entry is a symbolic link
-S Entry is a socket
-p Entry is a named pipe (a “fifo”)
-b Entry is a block-special file (like a mountable disk)
-c Entry is a character-special file (like an I/O device)
-u File or directory is setuid
-g File or directory is setgid
-k File or directory has the sticky bit set
-t The filehandle is a TTY (as reported by the isatty() system function; filenames can’t be tested by this test)
-T File looks like a “text” file
-B File looks like a “binary” file
-M Modification age (measured in days)
-A Access age (measured in days)
-C Inode-modification age (measured in days)

E PLURIBUS UNUM

2009-04-27T15:30:00.002-05:00

"Out of many, one"
http://www.greatseal.com/mottoes/unum.html:

"E Pluribus Unum" was suggested by the committee Congress appointed on July 4, 1776 to design "a seal for the United States of America." The below sketch of their design accompanied a detailed description of their idea for the new nation's official emblem.

A motto's purpose is to express the theme of a seal's imagery – especially that of the shield.

The center section of their shield has six symbols for "the Countries from which these States have been peopled:" the rose (England), thistle (Scotland), harp (Ireland), fleur-de-lis (France), lion (Holland), and an imperial two-headed eagle (Germany).

Linked together around the shield are 13 smaller shields, each with the initials for one of the "thirteen independent States of America."

Introduction

2009-04-27T09:40:00.001-05:00

http://www.linkedin.com/in/zfsu79

hide user's input

2009-04-23T08:52:00.002-05:00

when letting user input their password, do not show the password on the screen when user is typing.

M1.
print "Enter passwd: ";
system "stty -echo";
chop(my $passwd=);
system "stty echo";
print "\n";

M2.
use Term::ReadKey;
print "passwd: ";
ReadMode 2;
chop(my $passwd=);
ReadMode 0;
print "\n";

Perl: remove duplicated items from array

2009-04-22T13:42:00.002-05:00

#-Method 1---
my @array = ("abc1","d2ef","abc2","g1hi","g1hi","abc2","j1klm","abc1","d2ef");
my %hash = map { $_ => 1 } @array;
my @unique = keys %hash;
#-Method 2---
my %Seen = ();
my @unique = grep { ! $Seen{ $elem }++ } @array;
#-Method 3---always use associated array
%List{"item"} = 1;

PHP Session sharing on Clusters

2009-04-21T16:32:00.004-05:00

1. use reversed proxy to pass session id between nodes
2. setup a "public" disk to save session: say NFS drive, change session.save_path in php.ini.
3. save session in DB
4. memcache
5. share memory
Note: PHP is implemented using the "share nothing" architecture.

http://static.zend.com/topics/0200-T-WP-1107-R1-EN-PHP-is-not-Java-Seesions-in-PHP.pdf
http://www.caucho.com/articles/php-sessions.pdf
http://stackoverflow.com/questions/226442/whats-the-best-way-to-manage-php-sessions-in-an-lamp-cluster
http://coding.derkeiler.com/pdf/Archive/PHP/php.general/2007-03/msg00897.pdf

Perl Special Variables

2009-04-20T15:32:00.002-05:00

$0 name of the currently-running Perl script
$$ pid
$] perl version
....

see http://perldoc.perl.org/perlvar.html

SSH key

2009-04-20T13:29:00.003-05:00

1. ssh to server
2. mkdir ~/.ssh; chmod 700 ~/.ssh
3. cd ~/.ssh;
4. ssh-keygen -t dsa
5. cat id_dsa.pub >> .ssh/authorized_keys; chmod 600 authorized_keys
6.copy the private key (id_dsa) to your local PC
run puttygen.exe
"load" id_dsa
save that file to *.ppk
7. change putty settings under "connection > SSH > auth" to use *.ppk

Perl include path

2009-04-20T10:01:00.002-05:00

the PERLLIB environment variable
the PERL5LIB environment variable
the perl -Idir commpand line flag
the use lib pragma, as in
  use lib "$ENV{HOME}/myown_perllib";

Fortran: write w/ w/o newline

2009-04-16T15:27:00.004-05:00

write(*,'(A,$)') 'this is the first line'
write(*,'(A)') 'this continues the first line'
write(*,*) 'this is the second line'
write(*,'(/A)') 'this is the fourth line'

QSUB

2009-04-16T14:16:00.001-05:00

wjet MPI:
#!/bin/csh -f
#$ -N Job_Name
#$ -cwd
#$ -A ciaqex
# ask for how many CPUs
#$ -pe comp 16
#$ -p 10
# re-runable
#$ -r n
# walltime
#$ -l h_rt=8:00:00

wjet Serial job:
#!/bin/csh -f
#$ -N Job_Name
#$ -cwd
#$ -A ciaqex
# ask for how many CPUs
#$ -pe serial
#$ -l h_vmem=8192M (use "user_qacct -j $a_finished_JOB_ID" to check maxvmen)
# re-runable
#$ -r n
# walltime
#$ -l h_rt=8:00:00

ABE:
#PBS -l walltime=00:59:00
#PBS -l mem=10gb
#PBS -lnodes=2:ppn=8
#PBS -q normal
#PBS -V
#PBS -A oiz
#PBS -N Job_Name
#PBS -p 0

MM5 bug MHZ.c

2009-04-16T11:14:00.010-05:00

Found MM5 stunt at calling MHZ(), adjust MPP/mhz.c as below:

Original version:


...
mhz( meghz )
....

for (i = 0; i < size; ++i) {
       mlines[i] = (*loops[i])((int **)x[0], (int **)x[0]);
   }

mhz = lcm(mlines, size);

# if (ASSUME_HOMOGENEOUS_ENVIRONMENT == 1)
       *meghz = 100.0 ;
# else
       *meghz = mhz ;
# endif
       return ;

Since we set ASSUME_HOMOGENEOUS_ENVIRONMENT = 1, why not put the *meghz=100.0 ahead, like this:

Adjusted version:


...
mhz( meghz )
....
# if (ASSUME_HOMOGENEOUS_ENVIRONMENT == 1)
     *meghz = 100.0 ;
     return ;
# endif
for (i = 0; i < size; ++i) {
       mlines[i] = (*loops[i])((int **)x[0], (int **)x[0]);
   }

mhz = lcm(mlines, size);

# if (ASSUME_HOMOGENEOUS_ENVIRONMENT == 1)
       *meghz = 100.0 ;
# else
       *meghz = mhz ;
# endif
       return ;

Fortran - commandline parameters

2009-04-16T11:11:00.005-05:00

character*6 s_start, s_end
integer i_start, i_end
CALL GETARG(1, s_start) ! 1st argument
CALL GETARG(2, s_end) ! 2nd argument
s_start = trim(s_start)
s_end = trim(s_end)
read(s_start, '(i6)') i_start ! convert string to integer
read(s_end, '(i6)') i_end

convert between integer and characters:
write(c_month, '(I2.2)') i_month ! i_month -> s_month
read(c_month, '(i2)') i_month ! s_month -> i_month

Totalview: a good debug tool

2009-04-13T15:23:00.001-05:00

VI - Search and delete lines

2009-04-13T14:01:00.000-05:00

To delete all lines containing the word "junk":
[ESC]:%g/junk/d
[ESC]:%!egrep -v "junk"

To delete all lines which do NOT contain the work "junk":
[ESC]:%!egrep "junk"

redirect error to file

2009-04-12T20:22:00.001-05:00

system("./rad.exe V1 V2 > log 2>&1 &");

STDIN: 0
STDOUT: 1
STDERR: 2

SCP w/ wildcards

2009-04-06T14:12:00.000-05:00

put "" around the path, like this:
scp username@server:"/path/to/file.*" .

PBS

2009-04-06T11:43:00.003-05:00

qstat:
qstat -u {username}
qstat -f {jobID}

tracejob:
tracejob {jobID}

qsub:
#PBS -l walltime=00:30:00
#PBS -l mem=10gb
#PBS -lnodes=2:ppn=8
#PBS -q debug
#PBS -V
#PBS -A oiz
#PBS -N CCTM_DAILY
#PBS -m abe -M {email address}
#PBS -p 1023
Notice: the Priority acts just between my jobs, not all jobs.

ASCII cheat sheet

2009-04-03T15:09:00.006-05:00

From http://www.asciitable.com/

Linux: copy and keep all attributes.

2009-04-03T14:18:00.002-05:00

cp -@pr src dest

Mozart Music

2009-04-03T14:17:00.001-05:00

http://213.188.106.66/mozart00.htm

all .wma files, free for download.

How to avoid psswd by using ssh2

2009-04-03T14:10:00.003-05:00

on local: cd .ssh; ssh-keygen -t rsa to get id-rsa.pub
on remote: cd .ssh; insert id-rsa.pub into authorized_keys2
some machines may use "dsa" instead of "rsa"

PuTTY on Windows:

1. execute "puttygen.exe"
2. Load Private Key, load the file "id_rsa"
3. Save private key as "id_rsa.ppk".
4. PuTTY -> SSH -> Auth: use "id_rsa.ppk".

see http://linux-sxs.org/networking/openssh.putty.html for detail.

MAP

2009-04-03T14:08:00.002-05:00

PuTTY

2009-04-03T14:03:00.002-05:00

KiTTY: http://kitty.9bis.com/

PuTTY:
CTRL-F6 : send to tray
CTRL-F7 : always visible
CTRL-F9 : protect
CTRL-F12: roll up

watchdog.pl

2009-04-03T13:52:00.006-05:00

#!/usr/bin/perl
$user = $ARGV[0];
$action = $ARGV[1];
$DEBUG = ($ARGV[2]) ? $ARGV[2] : 0;
$selfpid = $$;

$dir = "/proc";
if($user eq "" || $action eq "") {
print "\n\tUsage: $0 owner path/to/file [DEBUG]\n\n";
exit(0);
}

open(WHO,"</etc/passwd") || exit(0);
@users = <who>;
close(WHO);

@true = grep /$user/,@users;
$who = $true[0];

exit(0) if (!$who);
print $who."\n" if $DEBUG;

$who =~ /\:(\d+)\:(\d+)/;
$myuid = $1;
$mygid = $2;
print $myuid.",".$mygid."\n" if $DEBUG;

opendir (DIR,$dir) || die "can't open\n";
@dirs = readdir (DIR);
closedir(DIR);

$list = "";
foreach $sub(@dirs){
$sub =~s/\s//g;
next unless ($sub=~/^(\d*)$/);
$pid = $1;
next if($pid == $selfpid);
$subdir = "$dir/$sub";
next unless (-d $subdir);
@stats = stat($subdir);
$uid = $stats[4];
$gid = $stats[5];

next unless ($uid == $myuid && $gid == $mygid);
open (CMD,"$subdir/cmdline") || die "cant open $!\n";
@cmdline = <cmd>;
close(CMD);
$re = $cmdline[0];
$list .= $re;
}#end foreach subdir

print $list."\n" if $DEBUG;
if($list=~/$action/) {
print "$action $n is RUNNING\n" if $DEBUG;
exit(0);
}else{
print "$action is not runing,start it!\n" if $DEBUG;
system("$action > /dev/null 2>&1 &");
exit(0);
}
exit(0);

VI cheat sheet

2009-04-03T08:39:00.003-05:00

Linux commands

2009-04-02T14:36:00.002-05:00

1. du -shc `ls -1`

2. ll | tr "[:lower:]" "[:upper:]"

3. svn status | cut -d/ -f2-

4. Cannot startup after modifying fstab:
enter fix mode, mount -o remount rw / to edit /etc/fstab, otherwise this file is readonly.

5. Add new HD:
fdisk /dev/hdb add partition
mkfs.ext3 /dev/hdb1
add line to /etc/fstab

6.`cat ../php.configure` run the connamds in file ../php.configure

VI common commands

2009-04-02T13:25:00.002-05:00

"(a-z)nyy define my buffer
"(a-z)p paste from my defined buffer
"np undelete the last N times
:e! give up all te modification, edit from the lat saved version

:set sw=n set margin width
n<< the following n lines move left a margin width
n>> the following n lines move right a margin width
^i move right a margin width in INSERT mode, =tab

:ab string1 string2 set abbreviation, usage: input string1, then ESC, string2 will automatically be inserted
una string1 unset the abbreviation of string1
fchar search the 1st char from the current position
Fchar search the 1st char from the current position, search backward
tchar searh forward in the current line for the 1st char, and locate to the left of the char
Tchar searh forward in the current line for the 1st char, and locate to the right of the char
:s/old/new replace
:g/text/command run command at all lines including text
:g/text1/s/text2/text3 replace text2 with text3 on those lines including text1
:v/text/command run command at all lines excluding text
:.= show the current line number
:= show the total line number of the file
^g show filename, line number, total line number, and position
:l show the content of the current line, including special characters
:r! ls insert the result of ls
:sh start shell, ^D back to vi
/^a search a in lines start with a
/a$ search a in lines end with a
( go to beginning of sentense
) go to end of sentense
{ go to beginning of paragraph
} go to beginning of next paragraph
^e screen scroll up 1 line
^y screen scroll down 1 line
^u screen scroll up half page
^d screen scroll down half page
^b screen scroll up 1 page
^f screen scroll down 1 page
^l refresh screen
z return set currentline at the top of screen
z. set current line at middle of the screen
z- set current line at bottom of the screen

options:
:set list show special characters
:set nolist do not show special characters
:set nu show line number
:set noic case insensetive when search
:set all print all options
:set ts=4 set tabstop=4
vi -r file edit the last saved version before file broken
vi -R file open file in readonly mode
vi +n file open file and locate at line n
vi + file open file and locate at the last line
vi +/string file open file and locate at the line including string
gUU turn all line to uppercase
gUw turn the word to uppercase
guu turn all line to lowercase
guw turn word to lowercase
CTRL-A number automatically increase

gUG turn the text from current line to eof to uppercase
guG turn the text from current line to eof to lowercase
gU:1 turn the text from current line to bof to uppercase
gu:1 turn the text from current line to bof to lowsercase
gUgg turn the text from current line to bof to uppercase
gugg turn the text from current line to bof to lowsercase
gg bof
~ swap uppercase and lowercase
b 1st char of current word or previous word
w 1st word of next word

:%s/^ *// remove the heading spaces
:%s/ *$// remove the ending spaces
di( remove text between (), maybe multi-lines
di) same as above
di< remove the text between <>, maybe multi-lines
di> same as above
di[ remove text between [], maybe multi-lines
di] same as above
di{ remove text between {}, maybe multi-lines
di} same as above

>aB move each line of current block right
* search the word where the cursor is on, and locate at the next found word

v select region
V select lines region
Use V to select region, then gU to change to uppercase

q+[a..z] define mico with name=a..z, end of definision with q, use with @+[a..z]

>> move right
<< move left

ggvG select all
Gvgg select all
vG select from current line to eof
vgg select from current line to bof

ctrl-w,n new window
ctrl-w,s split window
ctrl-w,v split window vertically
ctrl-w,c close window
ctrl-w,o close all other window
ctrl-w,w move to ext window
ctrl-w,arrow move between window

ESC, V, move cursor, :`<,`>s/old/new/ replace old with new in selected area

VI common commands -- how to remove the ^M at eol

2009-04-02T13:21:00.001-05:00

3 ways:

1. %! col -bx
2. :%s/[Ctrl-v][Enter]//g
3. set fileformat=unix