Monitor Memory and Disk Utilization on EC2 instances with Cloudwatch Custom metrics



As you know, in AWS we cannot monitor Hard Disk (Volume) and Memory (RAM) through CloudWatch but with few steps, we can monitor and set alarm on it according to our needs. So, in this post we will see, how can we accomplish that.

Step1.

Installation of dependencies (packages and binaries) in order to setup Memory and Disk utilization

RHEL 7
sudo yum install perl-Switch perl-DateTime perl-Sys-Syslog perl-LWP-Protocol-https perl-Digest-SHA --enablerepo="rhui-REGION-rhel-server-optional" -y
sudo yum install zip unzip -y
Amazon Linux 2 and Amazon Linux AMI
sudo yum install perl-Switch perl-DateTime perl-Sys-Syslog perl-LWP-Protocol-https perl-Digest-SHA.x86_64 -y 
sudo yum install zip unzip -y
SUSE Linux Enterprise Server
sudo zypper install perl-Switch perl-DateTime
sudo zypper install –y "perl(LWP::Protocol::https)"
Debian Based Systems 
sudo apt-get update
sudo apt-get install unzip libwww-perl libdatetime-perl


Step2.

Download and configure the "Memory" and "Disk/Volume" script

Create a folder cloudwatch
mkdir cloudwatch
Download the package into the cloudwatch directory
wget https://aws-cloudwatch.s3.amazonaws.com/downloads/CloudWatchMonitoringScripts-1.2.2.zip
Unzip the downloaded script
unzip CloudWatchMonitoringScripts-1.2.2.zip
Remove the download zip script compress file
rm CloudWatchMonitoringScripts-1.2.2.zip
Now go inside the extracted script directory
cd aws-scripts-mon
Create a copy of awscreds.template to awscreds.conf
cp awscreds.template awscreds.conf
Now edit the copy file and put AWSAccessId and AWSSecretKey
AWSAccessId=

AWSSecretKey=



Step 3.

Create a user cloudwatch user with Programmatic access

Go to IAM and create a user with following details -
Username - cloudwatchuser 
Access type - Programmatic access 
Permission - CloudWatchFullAccess
Copy the AWS Access ID and AWS Secret Key for next step to configure "awscred.conf"

Now, Paste here the AWSAccessId and AWSSecretKey copy in the last step into the awscreds.conf file

Varify Command
./mon-put-instance-data.pl --mem-util --verify --verbose
Original command
./mon-put-instance-data.pl --mem-used-incl-cache-buff --mem-util --mem-used --mem-avail
The memory commands All in One (this command is same as above command
./mon-put-instance-data.pl --mem-util --mem-used --mem-avail

now run the following command to send data to cloudwatch (Disk data)

Disk Utility
./mon-put-instance-data.pl --disk-space-util --disk-path=/dev/xvda1
Disk Space Available
./mon-put-instance-data.pl --disk-space-avail --disk-path=/dev/xvda1
Disk Space Used
./mon-put-instance-data.pl --disk-space-used --disk-path=/dev/xvda1
Disk All in One command
./mon-put-instance-data.pl --disk-space-util --disk-space-used --disk-space-avail --disk-path=/dev/xvda1

To see the all information related CPU, Memory and Disk details in the last 24 hours
./mon-get-instance-stats.pl --recent-hours=24


Step 4.

For help related to cronjob and other commands
./mon-put-instance-data.pl --help


Step 5.
To continuously send the data to CloudWatch. We will set a cronjob
*/5 * * * * /home/gautam/cloudwatch/aws-scripts-mon/mon-put-instance-data.pl --mem-util --disk-space-util --disk-path=/dev/xvda1 --from-cron

*/5 * * * * /home/gautam/cloudwatch/aws-scripts-mon/mon-put-instance-data.pl --mem-used --disk-space-used --disk-path=/dev/xvda1 --from-cron

*/5 * * * * /home/gautam/cloudwatch/aws-scripts-mon/mon-put-instance-data.pl --mem-avail --disk-space-avail --disk-path=/dev/xvda1 --from-cron



Step 6.
Now we are setup alarm for disk usage

Copy your instance id, Linux System > Filesystem, instanceId, MountPath => selct DiskSpaceUsed

Popular posts from this blog

How to redirect Drupal site from http to https?

Image
  Hello Guys, Today, We are going to see, how can we redirect our Drupal Site from http to https through .htaccess file with simple three lines of code. RewriteEngine On RewriteEngine On RewriteCond %{HTTPS} off RewriteRule (.*) https://%{HTTP_HOST}%{REQUEST_URI} [R=301,L] In cases where the HTTPS/SSL connection is ended at the load balancer and all traffic is sent to instances on port 80, the following rule works to redirect non-secure traffic. RewriteEngine On RewriteCond %{HTTP:X-Forwarded-Proto} !https RewriteRule (.*) https://%{HTTP_HOST}%{REQUEST_URI} [R=301,L] Ensure the mod_rewrite module is loaded. Source: Stackoverflow
Read more

WordPress Themes and Plugins Installation Problem

Image
WordPress plugins and themes installation problem Step 1 – Add the following line at the end of wp-config.php file define( 'FS_METHOD' , 'direct' ); Step 2 – Give 777 recursive permission to wp-content folder chmod -R 777 wp-content Most probably, this will fix all the issues of yours. But in case, you have bought and theme and plugins from some website like themeforest of other site and your theme or size is more than the size mentioned in php.in file. Then you need to increase the size of followings – upload_max_size post_max_size max_execution_size etc. and restart the apache service OR Best Solution: Simply give www-data user to user and group onwership to website serving directory
Read more

How to deploy NODE.JS application on Ubuntu 16.04/18.04

Image
Hi Friends, Today, we are going to deploy NodeJS sample application from GITHUB so you have a basic idea, How can we deploy NodeJS application in Ubuntu 16.04/18.04 Requirement:  Installation of NodeJS  Installation of GIT (If not installed)  GITHUB Sample application URL – https://github.com/contentful/the-example-app.nodejs Step 1: Install the curl package  [If not already installed] sudo apt-get update sudo apt-get install curl -y Step 2: Add the NodeJS PPA for install the NodeJS curl -sL https://deb.nodesource.com/setup_8.x | sudo bash -     [PPA for Long Term Support (LTS) version] Step 3: Install the NodeJS package sudo apt-get install nodejs -y Step 4: Clone the repository to root directory sudo -i git clone https://github.com/contentful/the-example-app.nodejs.git Step 5: Now install the npm package from where package.json is – cd the-example-app.nodejs npm install Step 6: Now finally run the NodeJS application [this application will run on port 3000...
Read more