Automated Hadoop, AWS, LVM and Docker using python.

Shivani Mandloi
4 min readNov 9, 2020

--

What is automation?

Automation is the creation and application of technologies to produce and deliver goods and services with minimal human intervention. The implementation of automation technologies, techniques and processes improve the efficiency, reliability, and/or speed of many tasks that were previously performed by humans.

Automation is being used in a number of areas such as manufacturing, transport, utilities, defense, facilities, operations and lately, information technology.

Automated provisioning

Automated provisioning allows an enterprise to deploy and configure infrastructure and applications, without the active participation of dedicated IT personnel, by using pre-defined procedures. Each step is carried out dynamically with new services being deployed and devices being attached (or detached) from the network. The entire process is bound by IT policies but does not require the manual work from IT staff.

Cloud automation

A set of processes and tools to replace manual tasks that provision and manage cloud workloads, cloud automation lets IT staff use time more strategically. It speeds tasks such as virtual machine deployments, and can reduce costs by reclaiming hardware resources and underused software licenses.

Automated deployment

Automated deployment is the process of eliminating manual steps from the creation of environments for software development and delivery. Typical uses include: Continuous delivery to automatically deploy, test and promote new builds, production deployments to orchestrate complex production deployments of applications and configuration, self-service that grants permission for other teams to do some of the work and incremental updates to deploy only partial or missing components.

Here we created created a menu driven program which automate Hadoop, Some AWS services, Logical Volume Management and Docker .

MAIN MENU:

IN HADOOP MENU:

HERE I CHOSE TO START DATANODE AND IT SAYS STARTING NAMENODE.

2. IN AWS WE HAVE PROVIDED FOLLOWING AUTOMATIONS:

3. IN LOGICAL VOLUME MANAGEMENT: HERE WE HAVE PROVIDED FOLLOWING MENUS

HERE I ENTERED 1 TO GET THE INFORMATION ABOUT HARDDISK

HERE WHEN WE CHOOSE 2 IT ASKS FOR DISK NAME ONCE YOU ENTER IT CREATES A PHYSICAL VOLUME, VOLUME GROUP AND CREATES FOLDER AND MOUNT IT.

THIS IS A OUTPUT OF LV DISPLAY AND YOU CAN CHECK THE FOLLOWING

HERE YOU CAN EXTEND THE SIZE OF LV:

HERE YOU CAN REDUCE THE LV SIZE:

4. DOCKER MENU CONTAINES:

5. LINUX BASIC MENU.

HERE YOU CAN AUTOMATICALLY GET SOME LINUX COMMAND RUN LIKE FOLLOWING:

HERE WHEN YOU PRESS 2 YOU GET WORKING DIRECTORY

LIKE THIS YOU CAN PERFORM ALL TASKS AND SAVE YOUR TIME….!!!!!

HERE WE COMPLETE OUR AUTOMATION TASK !!!!

ALSO THANKS TO TEAM MEMBERS FOR SUPPORTING ✌

  1. SAMIR GOUDA

2.HARSHAL THAKARE

https://github.com/HARSHAL732001

3. KULDEEP SINGH

https://github.com/Kuldeep-Lab

--

--

No responses yet