SRE/Devops

Connecting Grafana to CloudWatch

1.avif Basically, Grafana is an open-source program used for analytics and visualization. No matter where your data is kept, you can examine, validate, and display it with Grafana. Simply said, it offers several tools that may transform the data in your database into stunning graphs and visualizations.

MORE

Hosting a website for free, and secured via HTTPS

2.avif Nowadays, getting a website is not a particularly difficult job, but practically everyone wants to know how to build it for free. Therefore, you will learn all the processes required to build a free website through this blog.

The process’s two most crucial concepts must first be understood, though. You will need a domain name before you can build a website for free.

A domain name is an Internet resource name that is universally understood by Web servers and online organizations and provides all pertinent destination information. To access an organization’s Web-based services, website users must know the precise domain name.

MORE

Creating a Pipeline between Github action and EC2 instance for building a docker image and network

3.avif Contents: Introduction Establish a pipeline between Github and EC2 instance.

The definition of a pipeline with regard to DevOps must first be understood in order for us to comprehend the design of a pipeline fully.

A pipeline is a group of automated procedures or tools that developers use to create and release code into a live environment. Generally speaking, a pipeline consists of three primary parts:

Build automation/continuous integration: Test automation Deploy automation

It generally contains a set of tools that are divided into the following parts : Source Control Build tools Containerization Configuration Management Monitoring

MORE

How to get the name of EC2 from its instance-id using AWS Lambda

4.avif If you are an AWS user, you might have encountered a situation where you have to get the name of an EC2 instance from its instance ID. This can be a daunting task if you are new to AWS. Fortunately, with the help of AWS Lambda, it is now possible to automate this task and get the instance name in a few simple steps. In this blog, we will guide you through retrieving the name of an EC2 instance from its instance ID using AWS Lambda. So, let’s get started!

def ec2_name(instanceId): ec2r = boto3.resource('ec2') running_instances = ec2r.instances.filter( Filters=[{'Name': 'instance-state-name', 'Values': ['running']}, {'Name': 'instance-id', 'Values': [instanceId]}]) for instance in running_instances: for tag in instance.tags: if 'Name' in tag['Key']: name = tag['Value'] print(name) def lambda_handler(event, context): instanceIds = ["i-0d397eb19ba20063b", "i-0077a88cef38d609e"] for i in instanceIds: name = ec2_name(i) print(name)

Output:

Note: It will return the name for only instances which are running.

I hope this article was informative and provided you with the details you required. If you have any questions related while reading the blog, message me on Instagram or LinkedIn.For any kind of work related to DevOps, Site Reliability you can contact me at helpmeanubhav@gmail.com Special credits to my team members: Gaurav Kachariya and Krisha Amlani. Thank You…

Restarting inactive EC2 instance via AWS Lambda , Boto, and notifying an instace outage to Slack

5.avif Amazon Web Services (AWS) has become one of the most popular cloud computing services, providing a wide range of tools and services to help businesses run their operations smoothly and efficiently. Among its many offerings, the Elastic Compute Cloud (EC2) is a powerful and flexible service that allows users to easily deploy and manage virtual servers in the cloud.

However, even the most reliable systems can experience failures, and when an EC2 instance fails a status check, it can cause serious disruptions to your business. That’s where AWS Lambda comes in. With its ability to execute code automatically in response to events, Lambda provides an easy way to reboot a failed EC2 instance and send notifications to Slack, a popular team communication platform.

MORE

Monitoring EC2 instance status using AWS Lambda and Boto Library

6.avif As more businesses and organizations turn to cloud computing for their infrastructure needs, it becomes essential to keep track of the status of their resources in real time. Amazon Web Services (AWS) provides a powerful suite of tools to manage resources, including EC2 instances. However, keeping an eye on the status of your EC2 instances can be a time-consuming task.

Fortunately, AWS Lambda offers an efficient solution to automate this process. In this blog, we will explore how to monitor EC2 instance status using AWS Lambda and help you keep track of your resources with minimal effort. So, whether you’re a developer, an IT professional, or a business owner, this blog is for you! more

Argo CD with Kubernetes and GitOps

7.avif Welcome to my blog! Today, I want to introduce you to a powerful tool for managing your Kubernetes applications: Argo CD. Argo CD is a GitOps-based continuous delivery tool that allows developers to declaratively manage their application deployments by using git as the source of truth for their desired application state.

With Argo CD, you can easily deploy, update, and manage your applications in a Kubernetes cluster. By using git as the source of truth, you can ensure that the deployed application always matches the desired state defined in git and that everyone on your team is working with the same version of the application. This helps to promote collaboration and transparency in the deployment process. more

Hosting a custom mailbox to send Mail on cloudfare

8.avif This article discusses using HTML code to trigger a mailbox to send mail. To set up HTML code to start, go to our most recent tutorial. The benefit of adopting this approach is that the mail, from which you must send the letter, will be double-verified. Let’s start by performing the steps; more

Using Inotify for internal audit logs in windows and Linux

9.avif In the realm of monitoring cloud or on-premises applications and DevOps scripts, we frequently want functionalities such as receiving alerts of file creation, deletion, or modification throughout the file system with time stamps, permissions, and location. This feature is provided by the Linux kernel’s built-in function.

Inotify is a feature built-in to the Linux kernel, which also has analogs in most other operating systems: In Windows, filesystem changes are exposed via the Win32 Directory Change Notifications API or the .NET FileSystemWatcher() API. Such mechanisms allow tools to be aware of changes made to directories and/or files they’re interested in. more

Enable Alerts from AWS CloudWatch through Mail.

13.avifThis blog will show you how to receive alerts from AWS CloudWatch for any AWS service, such as EC2, through email and receive notifications for the same service.

I want to use it to monitor the performance of my AWS EC2 machine. You must first find a way to keep track of your workload so that you can make adjustments in order to cut costs. If the CPU use of your EC2 instance exceeds the threshold, alert management will notify you that Your EC2 instance CPU utilization is beyond the threshold and needed some action to be performed.

So let’s start our journey,*more

MLOps Pipeline via Jenkins and Hyperparameter Optimization

7.avif MLOps => Machine Learning + Operations, the easiest way to understand this is to put an MLOps pipeline into practice.

Let’s set up a pipeline on the AWS cloud using Jenkins and Docker. Additionally, we will employ hyperparameter tuning, which is a parameter whose value is used to regulate the learning process.more

Creating Azure Functions using VSCode Editor and Python

10.avifAzure Functions can be defined as the cloud services that are available on the Azure portal providing updated infrastructure and resources that are needed for running the applications. It is used to build web APIs, respond to database changes, process IoT streams, manage message queues, and more. 11.avif In this article, we will explore how to create a python function that will respond to HTTP requests. Here we will test the code locally and then deploy it on the serverless environment of Azure functions. more

Converting HTML files to RST via PyPandoc Python Library

12.avifLet's see a procedure to convert HTML to RST file using the PyPandoc library by using Python.

An RST file is a document that contains code that is written in the reStructuredText markup language. The reStructuredText is used to apply basic styles and format the plain texts. They are used mostly for technical documentation of python programs. more

Golang debugging by using Delve

13.avifGo is a compiled programming language designed by Robert Griesemer, Rob Pike, and Ken Thompson at google.

It is statically typed language which is syntactically similar to C language but offering additional features like structural typing, garbage collection, memory safety, and CSP-style concurrency.

more

Deploying Multiple Organizations in Hyperledger Fabric Version 2.0 & Monitering containers via cadvisor

4.avif We have seen till now the Hyperledger Architecture, we will go into depth of working in the consequent blogs.This blog helps you get started with Hyperledger Fabric Version 2.0 along with container monitoring via Googles Cadvisor , I will also discuss the differences in Flow as compared to Version 1.0 . Lets get started !! I have referred the Standard Hyperledger Fabric Documentation , and followed the relevant and optimized steps. The prerequisites for executing this will be installing :docker ,curl ,wget,npm,Go and Python,I will give give you commands for Ubuntu Systems to install Prerequisites.

more

Performance Testing of an Application via Locust

15.avif Are you a developer who is looking forward to performing load testing on your application?

You might have heard about tools like Apache JMeter, SmartMeter, WebLOAD, etc. All these tools require some installation efforts and also familiarity with the usage.

In case you are new to this and want to rapidly implement load testing, then Locust tool written in Python is the go-to solution for your problem. It’s a one-line installation on your Linux Terminal as shown below: 16.avifmore

Implementing Load Testing and Real-Time Monitoring with JMeter, InfluxDB, and Grafana

14.avif Real Time Monitoring Through this article, you will get to know about load testing using JMeter along with InfluxDB and Grafana. How the setup is done with the installation process mentioned below. Load testing can be defined as the process of software testing in which the application is tested under specific expected load. For this purpose, we will first need to install JMeter. Real-time monitoring is the process of collecting and storing performance metrics for data as it traverses your network. more

Convert Solidity Code to UML Flow Diagrams

3.avifAs a developer, it feels awesome when we can write safe and secure code. To bring clarity and debug code better every part of the source code can be represented in the form of visual diagrams like flowcharts, graphs, and UML Diagrams to bring clarity to a team of developers building great products and services. To solve this problem we will use VS Code extensions available for UML flow diagram generation. more

Web Hosting via IPFS and Pinata

17.avif In this blog, we will be discussing the web hosting technique via IPFS. So first let’s understand what IPFS mean.

IPFS stands for Interplanetary File system. It is a peer-to-peer network. It’s purpose is to store and provide access to files, websites, data, and applications. It allows users to host and receive content in a decentralized manner via peer-to-peer file sharing. This means that user-operators hold a portion of the overall data which creates a strong system of file storage and sharing. Now let’s understand the working of IPFS :

Usually, when we put a link or any URL in the browser, we technically ask the other computer for the page that we requested. But that’s not the only way we can retrieve the information, rather, if there is any replica of that page on the IPFS that we could use. more

Code and Content Sharing Made Simple via Tools and Web Apps

20.avifAre you looking to share some text or code from one computer machine or smartphone to another device rapidly without losing the indentation of the content or sharing the entire file. Yes we have some quick methods for the same. Group working via code sharing Lets explore the available platforms with relevant features. more

SonarQube integration with Azure DevOps and Svia Service Connections

21.avif About Sonarqube With this integration, we will be able to:

Import our Azure DevOps repositories into SonarQube so that we can easily set up SonarQube projects and analyze projects with Azure Pipelines, analysis into the build pipeline. Allow us to easily create SonarQube projects from the Azure DevOps Server repositories. This is also the first step in adding pull request decoration. The builtin SonarScanners running in Azure Pipelines jobs can automatically detect branches or pull requests being made, so we do not need to specifically pass them as parameters to the scanner (branch and pull request analysis is available starting in Developer Edition. Also we will be able to see our Quality Gate and code metric results right in Azure DevOps so that it is safe to merge the changes. 22.avif more

SonarQube Configuration , Installation ,Deployment via one-click-integration-script in Azure Devops using Decoker

23.avif SonarQube manual installation is always a pain for any DevOps Engineer wanting to do a DevSecOps testing on his ongoing code getting build, released and deployed via Azure Pipelines in the Production. Instead of doing installation and configurations which includes running scripts, setting up environment variables ,followed by troubleshooting in the linked Postgres DB and integration, getting things done spending some days, what if I say can be done within 15 mins ?

Yes it is possible .

Whenever wanting to avoid the configuration and installation steps to be done repeatedly avoiding the environment setting up issues, we will go with the best container tools in the market which is Docker. I would highly recommend any person implement this should have some basic knowledge about Docker Containers. To just go through the basics of Docker and standard Docker commands you can refer to this blog

Running Jenkins inside Docker Container, along with container within a container

24.avif Welcome to our technical blog on Jenkins and Dockers. Let me brief you about Jenkins and Docker.

Jenkins + Docker

Jenkins is a popular open-source automation tool that helps automate software building, testing, and deployment. Docker, on the other hand, is a platform that allows you to easily create, deploy, and run applications in containers.

In this blog, we will be discussing how to use these two powerful tools together. Whether you are new to these tools or a seasoned veteran, we hope that you will find this blog informative and helpful in your journey.

Let’s look at the procedures we should follow to run a docker container inside the Jenkins Container; more

How to Bind Python Code Executable .exe Files with Additional Library Folders

1.1.avif Build executable files for Python code and add data to the .exe file in the form of files or folders using auto-py-to-exe. Photo by James Harrison on Unsplash

Are you a developer looking to build executable files for your Python code along with adding some data to the .exe file in the form of files or folders? Yes, it is very much possible to solve this via auto-py-to-exe.

To make a simple .exe via your Python code with no links or adding of data via files or folders just follow my previous post.

To solve this problem I expect auto-py-to-exe to be installed in your workstation as shown below: 1.2.avifmore