How to mount Amazon S3 Bucket into AWS EC2 instance





Step 1
Update all the packages if required
(RHEL/CentOS)
yum update

(Debian/Ubuntu)
apt-get update

Step 2
Install all the dependencies require to configure
(RHEL/CentOS)
sudo yum install automake fuse fuse-devel gcc-c++ git libcurl-devel libxml2-devel make openssl-devel

(Debian/Ubuntu)
sudo apt-get install automake autotools-dev fuse g++ git libcurl4-gnutls-dev libfuse-dev libssl-dev libxml2-dev make pkg-config

Step 3
Clone the s3fs repository from the GitHub
(RHEL Family and Debian Family)
git clone https://github.com/s3fs-fuse/s3fs-fuse.git

Step 4
Now change directory to just clone from the GitHub and compile and setup the s3fs-fuse
cd s3fs-fuse

./autogen.sh

./configure --prefix=/usr --with-openssl

make

sudo make install


Step 5
Run the following command to check if every set up correctly
which s3fs
Output
/usr/bin/s3fs

Step 6
Now, Go to IAM and create a user name "s3user" and give him Programmatic Access and attached the Policy "AmazonS3FullAccess".

While creating a user, it will provide you "Access key ID" and "Secret access key". Note it down into a notepad or download the CSV file. We will need this for configuring the configuration file for s3fs.

Step 7
Now create a configuration file name "passwd-s3fs" under etc folder
vi /etc/passwd-s3fs

and enter the following into the file and save and exit
Access-key-ID:Secret-access-key
eg. AKIATJAADJMXQVLQIOSR:gUSMAUjXPJy4sAPa00+nntGpIjR0eWnL96M9AHOx

Step 8
Change the permission of the file
chmod 640 /etc/passwd-s3fs
Step 9
Now, create a directory into your ec2 instance where you want to mount the S3 Bucket
mkdir /gautam-bucket

Step 10
Now mount the S3 Bucket into created directory name "gautam-bucket"
sudo s3fs gautam-bucket /gautam-bucket -o passwd_file=/etc/passwd-s3fs

We have mounted the gautam-bucket into /gautam-bucket folder successfully. But But But this is not the secure way to access the bucket into ec2 instance because you have paste the Access key ID and Secret access key into the instance.

In-case your system compromise, hacker can easily steal your data. To overcome this situation we use roles.

Now we will umount the S3 Bucket and remove the passwd-s3fs file. We will now use the Roles to achieve this.

Step 11
Now we will create a role for ec2 to give permission "AmazonS3FullAccess"

Step 12
Go to ec2 instance dashboard select the instance, go to instance setting and attached the s3role with the instance.

Step 13
Now, mount the S3 Bucket again with IAM Role
s3fs -o iam_role="s3role" gautam-bucket /gautam-bucket
Congratulations. You have setup the S3 Bucket privately from your EC2 instance. 

Popular posts from this blog

How to reset MySQL root password in Ubuntu in latest Ubuntu versions 18.04 and above

Image
I have forget my MySQL root password and not able to login in phpMyAdmin. I am very bad in MySQL commandline. After long struggle while Googling, I found this solution in Stackoverflow - But this will work only latest Ubuntu version because of enhance security of MySQL.  First, as root, stop the mysql server.  systemctl stop mysql Next, create a /var/run/mysqld directory to be used by MySQL process to store and access socket file:  mkdir -p /var/run/mysqld chown mysql:mysql /var/run/mysqld Check that the newly created directory do exist. Now manually start MySQL with the following linux command and options:  /usr/sbin/mysqld --skip-grant-tables --skip-networking & Confirm that the process is running as expected:  jobs [1]+ Running sudo /usr/sbin/mysqld --skip-grant-tables --skip-networking;  Leave that terminal running and open another terminal, not as root. Now access MySQL database without password:  mysql -u root -p mysql> Using the MySQL session first flush privileges:  FLUS
Read more

Ubuntu default Firewall UFW (Uncomplicated Firewall) Command-Line

Image
  UFW - Uncomplicated Firewall The default firewall configuration tool for Ubuntu is ufw. Developed to ease iptablesfirewall configuration, ufw provides a user friendly way to create an IPv4 or IPv6 host-based firewall. By default UFW is disabled. Gufw is a GUI that is available as a frontend. Basic Syntax and Examples Default rules are fine for the average home user When you turn UFW on, it uses a default set of rules (profile) that should be fine for the average home user. That's at least the goal of the Ubuntu developers. In short, all 'incoming' is being denied, with some exceptions to make things easier for home users. Enable and Disable  Enable UFW  To turn UFW on with the default set of rules:  sudo ufw enable To check the status of UFW:  sudo ufw status verbose The output should be like this: youruser@yourcomputer:~$ sudo ufw status verbose  sudo] password for youruser:  Status: active  Logging: on (low)  Default: deny (incoming), allow (outgoing)  New profiles: ski
Read more

How to deploy Java Springboot application in Ubuntu 16.04/18.04

Image
  Hello Friends Today, I am going to show you how can we deploy a Java Spring-boot application in Ubuntu 16.04/18.04 Step 1: SSH to your server Step 2: Once you logged into server, update the Ubuntu packages sudo apt-get update Step 3: Install the Java package. It is required to run Jenkins. To add the PPA, It contains the Java sudo add-apt-repository ppa:webupd8team/java Press Enter key to continue. It will created the keyring Step 4: Update and Package after keyrings added and Run the Java Installation sudo apt-get update sudo apt install oracle-java8-installer Step 6: Click OK to accept License Agreement Click Yes to accept Oracle Binary Code License terms. Verify the installed Java version java -version javac -version Step 7: Next, we will install the maven, as it is the build tool for Java applications. sudo apt-get install maven -y Step 8: Now as we are going to deploy Java Spring-boot application. For this demo in going to clone a sample Java Spring-boot application from the GIT
Read more