Recently i have installed Ubuntu and trying to move all my work and tools ( some replacements ) in Ubuntu. The first thing i was troubled by was to install LAMP. After searching and reading some of the blogs it helped me to solve the problem.  Here is the collection of commands that helped out:

sudo aptitude purge apache2 apache2-common php5 php5-common libapache2-mod-php5 mysql-server
sudo aptitude install apache2 apache2-common php5 php5-common libapache2-mod-php5 mysql-server
sudo aptitude install phpmyadmin

Here are the 2 blog posts which helped me :  by wulfshayde and from here

Hopefully this will help others …