To install proftpd server

apt-get install proftpd

While installing there is a option to choose the type of installation, whether it is standalone or inetd installation, normally we need standalone installation, After installation the server will start automatically.

To start ftp server

/etc/init.d/proftpd start

To stop ftp server

/etc/init.d/proftpd stop

Now we will go through configuration of ftp server
proftpd configuration file is located at /etc/proftpd/proftpd.conf
To edit configuration use

vi /etc/proftpd/proftpd.conf

Default configuration file can be found here

By default proftpd will give access to the home path (to know home directory of users cat /etc/passwd)

DefaultRoot ~

// This will limit the user smanne to /var/www/ folder
DefaultRoot /var/www/ smanne

To change default file permissions

// this will give default 755 permission to all the new and updated files
Umask                           022  022 

// this will give 775 permission,
Umask 			      002  002

You can also change the port number, max connections,

For more proftpd configurations refer – http://www.proftpd.org/docs/example-conf.html

http://www.howtoforge.com/mysql_database_replication

This article contains simple copy & paste steps to configure MySql replication, if you need more detailed indepth explanation on different configuration settings then go to

http://dev.mysql.com/doc/refman/5.0/en/replication.html

It performed well, so being a fan of open source, thought of releasing that code and uploaded it to google code. Here is the link

Downloadable binary is not yet posted you need to compile it from source code

If you come across any bugs or improvements please feed us back.

Screenshots

Test server, you need to start server on all servers from where u need to test

Monitoring server with MySQL admin while testing

#!/bin/bash

export EC2_HOME=/home/sandeep/ec2/ec2-api-tools-1.3-46266
PATH=$EC2_HOME/bin:$PATH
export EC2_PRIVATE_KEY=/home/sandeep/ec2/pk-XXXXXXXXXXXXXXXXXXXXXXXX.pem
export EC2_CERT=/home/sandeep/ec2/cert-XXXXXXXXXXXXXXXXXXXXXXXX.pem
export EC2_URL=https://us-east-1.ec2.amazonaws.com
export JAVA_HOME=/usr/lib/jvm/java-6-sun/jre/

export amiid="ami-0d5db264"
export key="xxxxsshkeyxxxx"
export zone="us-east-1d"
export id_file="/home/sandeep/ec2/keyxxx.pem"
export group="default"

#
# Start the instance
#
echo Launching AMI ${amiid}
${EC2_HOME}/bin/ec2-run-instances ${amiid} -z ${zone}
                         -k ${key} --group ${group}  > /tmp/a
if [ $? != 0 ]; then
   echo "Error starting instance for image" ${amiid}
   exit 1
fi
export iid=`cat /tmp/a | grep INSTANCE | cut -f2`

#
# Loop until the status changes to 'running'
#
sleep 30
echo Starting instance ${iid}
export RUNNING="running"
export done="false"
while [ $done == "false" ]
do
   export status=`${EC2_HOME}/bin/ec2-describe-instances ${iid} | grep INSTANCE | cut -f6`
   if [ $status == ${RUNNING} ]; then
      export done="true"
   else
      echo Waiting...
      sleep 10
   fi
done
echo Instance ${iid} is running

Please feel free to post any comments or errors XX

We need apache, nginx to work with this tutorial
To install nginx on debian please follow this link

http://timothybowler.com/2009/11/25/compiling-nginx-on-debian-lenny/

Note: Dont install using aptitude it contains older version where gzip and proxy module not available,

Modify apache ports.conf to run apache on port 8080

Add this lines to default site of nginx

server {
listen 80;
server_name debianzone.com;
location / {
proxy_pass http://debianzone.com:8080;
proxy_cache debianzone-cache;
proxy_cache_valid  200 302  60m;
proxy_cache_valid  404      1m;
}
} 

Add this in http section of nginx.conf

http {
proxy_cache_path  /var/www/cache levels=1:2 keys_zone=debianzone-cache:8m max_size=1000m inactive=600m;
proxy_temp_path /var/www/cache/tmp;
}

Download Google chrome for Debian

For developers it has developer tools which looks like firebug, but it`s not so power full like firebug, to open developer tools click

ctrl + shift + i

It also supports extensions and themes

At present i can say it as just an alternate browser, but not total replacement for firefox, let me test the stability of chrome for some more time

First, you need to choose your RAID implementation. Personally, I prefer to use RAID 5 on Amazon EC2, combined with LVM2.

For setting a RAID 5 up and running you will need to raise at least 3 EBS volumes and attach them to your instance (let’s say: sdb1, sdb2, sbd3).

Using mdadm you will setup your RAID array (/dev/md1):
$ mdadm --create /dev/md1 --level=raid5 \
> --chunk=64 --parity=left-symmetric \
> --raid-devices=3 /dev/sdb1 /dev/sdb2 /dev/sdb3
(if it doesn’t work, try forcing with the param –force).

Wait for the sync to finish. For monitoring the sync operation, keep an eye on /proc/mdstat with a simple cat:
$ cat /proc/mdstat
After synced, create the filesystem:
$ mkfs.ext3 -b 4096 -R stride=16 /dev/md1
(of course, you can create the filesystem of your choice here).

Mount it:
$ mkdir /path/where/you/wish/to/mount # this step is not required if you already have your path to mount the RAID
$ mount –t ext3 /dev/md1 /path/where/you/wish/to/mount
If you want to mount it at the boot:$ mdadm --detail --scan > /etc/mdadm/mdadm.conf
Add a line to your /etc/fstab:
# <file system> <mount point>                 <type>  <options> <dump>  lt;pass>
/dev/md1        /path/where/you/wish/to/mount ext3    defaults 0       2
Please, note that all these commands must be run as root.

Usually, at initialization mdadm can get confused when trying to scan your devices. Make sure you have a line “DEVICE” in the top of your / etc/mdadm/mdadm.conf and if it’s properly set.

Not always the value “partitions” works fine, so try to be specific.

Examples:
DEVICE /dev/sdb[1-3]

– OR –

DEVICE /dev/sdb1 /dev/sdbx  # where x is your device numberI hope these tips can be of some help. Soon, I’ll be posting the next part, where I’ll talk about LVM.

Cheers!

I must confess I’m pretty much adept to Debian, but I was forced to be unbiased and start researching for better options for achieving my goal. Also because the environment I was going to port was already running Debian, but the application’s traffic growth was increasing at high speed and it seemed something was going on with that server.

Why not Debian?

Well, I had to choose some distribution where I could have my packages being compiled locally to comply with a few standards, like packages must be compiled specifically for the processor they’re running under, improve at compilation how programs make their calculations and it can be done only knowing exactly where you’re running your program, and more. Unfortunately, Debian maintains their packages pre-compiled, which means that they don’t know where they’re installing into, so they’re compiled with generic options and it can be a performance issue when talking about millions of users connected to your Apache. Let’s say that if the package takes 50KB of memory per request more than a package specifically compiled to the computer set it’s running under, for each 5000 users connected to my application I’ll need more 240MB of RAM. Well, things get bit harder if we multiply this by 10 and so on.

This thing was upsetting me, I didn’t want to simply abandon Debian without doing some research before. I found great distros to fulfill my requirements, such as Gentoo or Slackware… but I was leaving Debian…

Then I was about to really adopt Gentoo to achieve my goal, when I was talking to a friend of mine (which also is a Debian addict) and he said that it was possible to recompile packages locally with not much efforts and close (not that much, actually) to the Gentoo’s portage.

And then I found apt-build. It was pretty good! Despite the fact it took the whole week to recompile the whole distribution, it works pretty fine and I could get pretty close to my objective. Well, it was not that easy to get things exactly the way I wanted, but finally I could see it was possible.

Why Debian?

Indeed, I could really drop Debian and start using Gentoo or Slackware easily. But I had to be persistent to figure out a way to keep using Debian. Why? Well, package management is quite stable, I like the way they manage versions and Debian is a distribution I trust for years. Despite the fact I can get support very easy on the net and if I really need something installed quickly or if it’s a non-regular service I can still using aptitude (or apt-get).

The Result

After much work and efforts, I got an AMI with a high-tuned Debian inside. A clean and base install of Debian GNU/Linux 5.0.3 Lenny. Right now, I just have the 32 bit for m1.small and c1.medium, but soon I will get a 64 bit done.

Features

Kernel, RamDisk, Kernel modules and Filesystem Userspace:

• Uses the Canonical 2.6.28-12-xen-i386 Kernel (aki-21f01148) patched to be used on Debian Lenny.
• Uses the Canonical 2.6.28-12-xen-i386 RAM Disk (ari-3bf01152) patched to be used on Debian Lenny.
• All 2.6.28 kernel modules installed and running.
• Updated with Fuse 2.8.1.

Improved Performance:

• All installed Debian Packages _recompiled_ with GCC 4.3.2 and libc6 (xen and i686) for improved performance using Optimization level 3 (read more about GCC optmization options at http://gcc.gnu.org/onlinedocs/gcc/Optimize-Options.html and http://gcc.gnu.org/onlinedocs/gcc/i386-and-x86_002d64-Options.html) and:
• march=i686 (set PentiumPro instructions. Amazon EC2 – currently, Intel Xen 2.6GHz single core emulation – processor and Kernel in use are 686 compliant, but Debian packages are compiled as i386 for generic usage).
• mfpmath=sse and msse for scalar floating point instructions to increase applications’ speed and avoid the default 387 instability problems.
• ffast-math to increase processor speed with math optimizations (Note that I used this flag only on IEEE and ISO math operation compliant applications. Don’t use it if you’re not sure if your application is compliant to IEEE and ISO specifications for math operations).
• Still, I didn’t skip the debugging output (-g), so if you realize that any package is performing weirdly, please, debug it and let me know commenting in this post. I will fix it and raise a new AMI with the fix.
• Kernel modules recompiled from the source (2.6.28.10) retrieved from www.kernel.org, optimized to the Amazon’s Xen environment. All security patches applied.

Packages:

• Packages up-to-date.
• OpenBSD SSH and Linux Screen for remote administration.
• OpenSSL and CA Certificates for SSL and TLS support.
• Amazon EC2 first boot script.
• Amazon EC2 Tools 1.3.
• Unused packages fully purged from system.

Security:

• Shadow passwords enabled.
• root password locked. Remote access is made only using the Keypair used to launch the instance.
• ssh PasswordAuthentication disabled.

Conclusion

I have proven to myself I could really have Debian running for an HPC environment smoothly, what  makes me even prouder of this distro.

If you want to check the result, the AMI ID is ami-2d759644. If you do so, I’d be glad to hear from you.

/bin/hostname your-host-name

To change the host name permanently use

/etc/hostname
/etc/init.d/hostname.sh start

RRDTool: RRDtool is the OpenSource industry standard, high performance data logging and graphing system for time series data. Use it to write your custom monitoring shell scripts or create whole applications using its Perl, Python, Ruby, TCL or PHP bindings.

AWStats: AWStats is a free powerful and featureful tool that generates advanced web, streaming, ftp or mail server statistics, graphically. This log analyzer works as a CGI or from command line and shows you all possible information your log contains, in few graphical web pages.

Analog: Analog is a program to measure the usage on your web server. It tells you which pages are most popular, which countries people are visiting from, which sites they tried to follow broken links from, and all sorts of other useful information.

Piwik: Piwik is a downloadable, open source (GPL licensed) web analytics software program. It provides you with detailed real time reports on your website visitors: the search engines and keywords they used, the language they speak, your popular pages…

Piwik aims to be an open source alternative to Google Analytics.

Piwik is a PHP MySQL software program that you download and install on your own webserver. At the end of the five minute installation process you will be given a JavaScript tag. Simply copy and paste this tag on websites you wish to track (or use an existing plugin to do it automatically for you).