SRE/Devops
Connecting Grafana to CloudWatch
Basically, Grafana is an open-source program used for analytics and visualization. No matter where your data is kept, you can examine, validate, and display it with Grafana. Simply said, it offers several tools that may transform the data in your database into stunning graphs and visualizations.
Hosting a website for free, and secured via HTTPS
Nowadays, getting a website is not a particularly difficult job, but practically everyone wants to know how to build it for free. Therefore, you will learn all the processes required to build a free website through this blog.
The process’s two most crucial concepts must first be understood, though. You will need a domain name before you can build a website for free.
A domain name is an Internet resource name that is universally understood by Web servers and online organizations and provides all pertinent destination information. To access an organization’s Web-based services, website users must know the precise domain name.
Creating a Pipeline between Github action and EC2 instance for building a docker image and network
Contents: Introduction Establish a pipeline between Github and EC2 instance.
The definition of a pipeline with regard to DevOps must first be understood in order for us to comprehend the design of a pipeline fully.
A pipeline is a group of automated procedures or tools that developers use to create and release code into a live environment. Generally speaking, a pipeline consists of three primary parts:
Build automation/continuous integration: Test automation Deploy automation
It generally contains a set of tools that are divided into the following parts : Source Control Build tools Containerization Configuration Management Monitoring
How to get the name of EC2 from its instance-id using AWS Lambda
If you are an AWS user, you might have encountered a situation where you have to get the name of an EC2 instance from its instance ID. This can be a daunting task if you are new to AWS. Fortunately, with the help of AWS Lambda, it is now possible to automate this task and get the instance name in a few simple steps. In this blog, we will guide you through retrieving the name of an EC2 instance from its instance ID using AWS Lambda. So, let’s get started!
def ec2_name(instanceId): ec2r = boto3.resource('ec2') running_instances = ec2r.instances.filter( Filters=[{'Name': 'instance-state-name', 'Values': ['running']}, {'Name': 'instance-id', 'Values': [instanceId]}]) for instance in running_instances: for tag in instance.tags: if 'Name' in tag['Key']: name = tag['Value'] print(name) def lambda_handler(event, context): instanceIds = ["i-0d397eb19ba20063b", "i-0077a88cef38d609e"] for i in instanceIds: name = ec2_name(i) print(name)
Output:
Note: It will return the name for only instances which are running.
I hope this article was informative and provided you with the details you required. If you have any questions related while reading the blog, message me on Instagram or LinkedIn.For any kind of work related to DevOps, Site Reliability you can contact me at helpmeanubhav@gmail.com Special credits to my team members: Gaurav Kachariya and Krisha Amlani. Thank You…
Restarting inactive EC2 instance via AWS Lambda , Boto, and notifying an instace outage to Slack
Amazon Web Services (AWS) has become one of the most popular cloud computing services, providing a wide range of tools and services to help businesses run their operations smoothly and efficiently. Among its many offerings, the Elastic Compute Cloud (EC2) is a powerful and flexible service that allows users to easily deploy and manage virtual servers in the cloud.
However, even the most reliable systems can experience failures, and when an EC2 instance fails a status check, it can cause serious disruptions to your business. That’s where AWS Lambda comes in. With its ability to execute code automatically in response to events, Lambda provides an easy way to reboot a failed EC2 instance and send notifications to Slack, a popular team communication platform.
Monitoring EC2 instance status using AWS Lambda and Boto Library
As more businesses and organizations turn to cloud computing for their infrastructure needs, it becomes essential to keep track of the status of their resources in real time. Amazon Web Services (AWS) provides a powerful suite of tools to manage resources, including EC2 instances. However, keeping an eye on the status of your EC2 instances can be a time-consuming task.
Fortunately, AWS Lambda offers an efficient solution to automate this process. In this blog, we will explore how to monitor EC2 instance status using AWS Lambda and help you keep track of your resources with minimal effort. So, whether you’re a developer, an IT professional, or a business owner, this blog is for you! more
Argo CD with Kubernetes and GitOps
Welcome to my blog! Today, I want to introduce you to a powerful tool for managing your Kubernetes applications: Argo CD. Argo CD is a GitOps-based continuous delivery tool that allows developers to declaratively manage their application deployments by using git as the source of truth for their desired application state.
With Argo CD, you can easily deploy, update, and manage your applications in a Kubernetes cluster. By using git as the source of truth, you can ensure that the deployed application always matches the desired state defined in git and that everyone on your team is working with the same version of the application. This helps to promote collaboration and transparency in the deployment process. more
Hosting a custom mailbox to send Mail on cloudfare
This article discusses using HTML code to trigger a mailbox to send mail. To set up HTML code to start, go to our most recent tutorial. The benefit of adopting this approach is that the mail, from which you must send the letter, will be double-verified. Let’s start by performing the steps; more
Using Inotify for internal audit logs in windows and Linux
In the realm of monitoring cloud or on-premises applications and DevOps scripts, we frequently want functionalities such as receiving alerts of file creation, deletion, or modification throughout the file system with time stamps, permissions, and location. This feature is provided by the Linux kernel’s built-in function.
Inotify is a feature built-in to the Linux kernel, which also has analogs in most other operating systems: In Windows, filesystem changes are exposed via the Win32 Directory Change Notifications API or the .NET FileSystemWatcher() API. Such mechanisms allow tools to be aware of changes made to directories and/or files they’re interested in. more
Enable Alerts from AWS CloudWatch through Mail.
This blog will show you how to receive alerts from AWS CloudWatch for any AWS service, such as EC2, through email and receive notifications for the same service.
I want to use it to monitor the performance of my AWS EC2 machine. You must first find a way to keep track of your workload so that you can make adjustments in order to cut costs. If the CPU use of your EC2 instance exceeds the threshold, alert management will notify you that Your EC2 instance CPU utilization is beyond the threshold and needed some action to be performed.
So let’s start our journey,*more
MLOps Pipeline via Jenkins and Hyperparameter Optimization
MLOps => Machine Learning + Operations, the easiest way to understand this is to put an MLOps pipeline into practice.
Let’s set up a pipeline on the AWS cloud using Jenkins and Docker. Additionally, we will employ hyperparameter tuning, which is a parameter whose value is used to regulate the learning process.more
Creating Azure Functions using VSCode Editor and Python
Azure Functions can be defined as the cloud services that are available on the Azure portal providing updated infrastructure and resources that are needed for running the applications. It is used to build web APIs, respond to database changes, process IoT streams, manage message queues, and more. In this article, we will explore how to create a python function that will respond to HTTP requests. Here we will test the code locally and then deploy it on the serverless environment of Azure functions. more
Converting HTML files to RST via PyPandoc Python Library
Let's see a procedure to convert HTML to RST file using the PyPandoc library by using Python.
An RST file is a document that contains code that is written in the reStructuredText markup language. The reStructuredText is used to apply basic styles and format the plain texts. They are used mostly for technical documentation of python programs. more
Golang debugging by using Delve
Go is a compiled programming language designed by Robert Griesemer, Rob Pike, and Ken Thompson at google.
It is statically typed language which is syntactically similar to C language but offering additional features like structural typing, garbage collection, memory safety, and CSP-style concurrency.
Deploying Multiple Organizations in Hyperledger Fabric Version 2.0 & Monitering containers via cadvisor
We have seen till now the Hyperledger Architecture, we will go into depth of working in the consequent blogs.This blog helps you get started with Hyperledger Fabric Version 2.0 along with container monitoring via Googles Cadvisor , I will also discuss the differences in Flow as compared to Version 1.0 . Lets get started !! I have referred the Standard Hyperledger Fabric Documentation , and followed the relevant and optimized steps. The prerequisites for executing this will be installing :docker ,curl ,wget,npm,Go and Python,I will give give you commands for Ubuntu Systems to install Prerequisites.
Performance Testing of an Application via Locust
Are you a developer who is looking forward to performing load testing on your application?
You might have heard about tools like Apache JMeter, SmartMeter, WebLOAD, etc. All these tools require some installation efforts and also familiarity with the usage.
In case you are new to this and want to rapidly implement load testing, then Locust tool written in Python is the go-to solution for your problem. It’s a one-line installation on your Linux Terminal as shown below: more
Implementing Load Testing and Real-Time Monitoring with JMeter, InfluxDB, and Grafana
Real Time Monitoring Through this article, you will get to know about load testing using JMeter along with InfluxDB and Grafana. How the setup is done with the installation process mentioned below. Load testing can be defined as the process of software testing in which the application is tested under specific expected load. For this purpose, we will first need to install JMeter. Real-time monitoring is the process of collecting and storing performance metrics for data as it traverses your network. more
Convert Solidity Code to UML Flow Diagrams
As a developer, it feels awesome when we can write safe and secure code. To bring clarity and debug code better every part of the source code can be represented in the form of visual diagrams like flowcharts, graphs, and UML Diagrams to bring clarity to a team of developers building great products and services. To solve this problem we will use VS Code extensions available for UML flow diagram generation. more
Web Hosting via IPFS and Pinata
In this blog, we will be discussing the web hosting technique via IPFS. So first let’s understand what IPFS mean.
IPFS stands for Interplanetary File system. It is a peer-to-peer network. It’s purpose is to store and provide access to files, websites, data, and applications. It allows users to host and receive content in a decentralized manner via peer-to-peer file sharing. This means that user-operators hold a portion of the overall data which creates a strong system of file storage and sharing. Now let’s understand the working of IPFS :
Usually, when we put a link or any URL in the browser, we technically ask the other computer for the page that we requested. But that’s not the only way we can retrieve the information, rather, if there is any replica of that page on the IPFS that we could use. more
Code and Content Sharing Made Simple via Tools and Web Apps
Are you looking to share some text or code from one computer machine or smartphone to another device rapidly without losing the indentation of the content or sharing the entire file. Yes we have some quick methods for the same. Group working via code sharing Lets explore the available platforms with relevant features. more
SonarQube integration with Azure DevOps and Svia Service Connections
About Sonarqube With this integration, we will be able to:
Import our Azure DevOps repositories into SonarQube so that we can easily set up SonarQube projects and analyze projects with Azure Pipelines, analysis into the build pipeline. Allow us to easily create SonarQube projects from the Azure DevOps Server repositories. This is also the first step in adding pull request decoration. The builtin SonarScanners running in Azure Pipelines jobs can automatically detect branches or pull requests being made, so we do not need to specifically pass them as parameters to the scanner (branch and pull request analysis is available starting in Developer Edition. Also we will be able to see our Quality Gate and code metric results right in Azure DevOps so that it is safe to merge the changes. more
SonarQube Configuration , Installation ,Deployment via one-click-integration-script in Azure Devops using Decoker
SonarQube manual installation is always a pain for any DevOps Engineer wanting to do a DevSecOps testing on his ongoing code getting build, released and deployed via Azure Pipelines in the Production. Instead of doing installation and configurations which includes running scripts, setting up environment variables ,followed by troubleshooting in the linked Postgres DB and integration, getting things done spending some days, what if I say can be done within 15 mins ?
Yes it is possible .
Whenever wanting to avoid the configuration and installation steps to be done repeatedly avoiding the environment setting up issues, we will go with the best container tools in the market which is Docker. I would highly recommend any person implement this should have some basic knowledge about Docker Containers. To just go through the basics of Docker and standard Docker commands you can refer to this blog
Running Jenkins inside Docker Container, along with container within a container
Welcome to our technical blog on Jenkins and Dockers. Let me brief you about Jenkins and Docker.
Jenkins + Docker
Jenkins is a popular open-source automation tool that helps automate software building, testing, and deployment. Docker, on the other hand, is a platform that allows you to easily create, deploy, and run applications in containers.
In this blog, we will be discussing how to use these two powerful tools together. Whether you are new to these tools or a seasoned veteran, we hope that you will find this blog informative and helpful in your journey.
Let’s look at the procedures we should follow to run a docker container inside the Jenkins Container; more
How to Bind Python Code Executable .exe Files with Additional Library Folders
Build executable files for Python code and add data to the .exe file in the form of files or folders using auto-py-to-exe. Photo by James Harrison on Unsplash
Are you a developer looking to build executable files for your Python code along with adding some data to the .exe file in the form of files or folders? Yes, it is very much possible to solve this via auto-py-to-exe.
To make a simple .exe via your Python code with no links or adding of data via files or folders just follow my previous post.
To solve this problem I expect auto-py-to-exe to be installed in your workstation as shown below: more