[FinOps] Using Open Source Bill Bot to Receive AWS Cost Reports via Slack

-

What is Bill Bot? 

- This open-source solution allows you to receive cost reports via Slack on a daily and monthly basis. The contributors are Christian Bonzelet, an AWS Solutions Architect from Germany, and Mauricio Klein, a developer from Spain. This setup has been verified and is available as open-source for anyone to use.

reference: https://github.com/cremich/cdk-bill-bot


Bill Bot Architecture:

- The core of Bill Bot is storing CUR data in AWS S3. CUR stands for AWS Cost and Usage Report, which represents cost reports. The CUR data stored in S3 is crawled using Glue crawlers to create/update a database in the Data Catalog.

At this point, AWS Athena is ready to query the data. The step function operates based on a scheduled time, which is set to 8 AM UTC by default. The step function works by using a Lambda function to calculate the date for the previous day, then queries the billing data for that date using Athena. Finally, it executes a Lambda function to send the query results to Slack, allowing you to receive alerts via Slack.


HOW CUR is storing data in S3?

1. Report Creation: You first create a Cost and Usage Report in the AWS Billing Console.

2. Configuration: Specify the Amazon S3 bucket where you want the report to be delivered.

3. Delivery: AWS generates the report and delivers it to the specified S3 bucket. The report is updated at least once a day and can be configured to update up to three times a day12.

4. Format: The report files are in CSV format, which can be accessed using spreadsheet software or applications via the Amazon S3 API


[S3 bucket policy]

{

    "Statement": [

        {

            "Effect": "Allow",

            "Principal": {

                "Service": "billingreports.amazonaws.com"

            },

            "Action": [

                "s3:GetBucketAcl",

                "s3:GetBucketPolicy"

            ],

            "Resource":"arn:aws:s3:::DOC-EXAMPLE-BUCKET",

            "Condition": {

                "StringEquals": {

                    "aws:SourceArn": "arn:aws:cur:us-east-1:${AccountId}:definition/*",

                    "aws:SourceAccount": "${AccountId}"

                }

            }

        },

        {

            "Sid": "Stmt1335892526596",

            "Effect": "Allow",

            "Principal": {

                "Service": "billingreports.amazonaws.com"

            },

            "Action": "s3:PutObject",

            "Resource": "arn:aws:s3:::DOC-EXAMPLE-BUCKET/*",

            "Condition": {

                "StringEquals": {

                    "aws:SourceArn": "arn:aws:cur:us-east-1:${AccountId}:definition/*",

                    "aws:SourceAccount": "${AccountId}"

                }

            }

        }

    ]

}


Once the open-source Bill Bot setup is complete, you can receive the following results.



Bill Bot offers the advantage of easily monitoring cloud costs, enabling businesses and individuals to analyze costs and prevent waste.

Comments

Post a Comment

Popular posts from this blog

[Kubernetes] Node Overcommitted

-
Image
Recap on Requests and Limits Requests Pods are allocated to nodes based solely on the specific CPU and Memory requirements. In other words, a pod is assigned for a node if the available capacity on that node can accommodate the additional CPU and Memory requested by the pod.  Limits Pod Scheduling does not take limits into account, but limits play a crucial role for different purposes. They establish an upper limit on the resources a pod can acquire before facing throttling or running out of memory. This precautionary measure prevents a single pod from monopolizing all resources on a node due to any deficiencies.  it is crucial to understand that reaching the CPU limit does not result in pod eviction; instead, it leads to throttling, potentially causing application failure. However, surpassing the Memory limit results in an out-of-memory (OOM) condition, necessitating pod eviction.  [example of overcommit] Now, if the node is anywhere close to reservation capacity then na...
Read more

[AWS] What is the Cloud Formation?

-
Image
  What is AWS CloudFormation? AWS CloudFormation is a service that helps you model and set up your Amazon Web Services resources so that you can spend less time managing those resources and more time focusing on your applications that run in AWS. You create a template that describes all the AWS resources that you want (like Amazon EC2 instances or Amazon RDS DB instances), and AWS CloudFormation takes care of provisioning and configuring those resources for you. AWS CloudFormation Basics: In CloudFormation, you work with Templates and Stacks. Template:  JSON or YAML formatted text file which is a blueprint of your AWS resources. Stack:  In CloudFormation, you manage resources as a single unit called a Stack. All the resources in a stack are defined by the stack’s Template. Hence the AWS CloudFormation workflow can be summarized as the below image  reference: docs.aws.amazon.com. example of cloud formation configuration which is I made it by myself.
Read more

How to Install jenkins using Helm chart on instance

-
How to install Jenkins using Helm Chart on instance Prerequisites To follow along with this post you need to use a Kubernetes cluster and Helm chart. All major cloud provides offer hosted Kubernetes clusters: 1. AWS: EKS 2. Azure: AKS 3. Google Cloud: GKE you must also have the Helm Client installed. The Helm documentation provides install instructions. [Helm documentation: https://helm.sh/docs/intro/install/ ] we also have a way to deploy Jenkins on your local machine, but we will not explain it on this post.  Adding the Jenkins Chart repository $ helm repo add jenkins https://charts.jenkins.io $ helm repo update $ helm repo list Deploying a simple Jenkins instance To deploy a jenkins instance with the default settings, run this command: $ helm upgrade --install jenkins(jenkins_name) jenkins/jenkins  its the easiest way to deploy jenkins with default values. but I will introduce how to deploy Jenkins to LoadBalancer type. I will share the Helm-Jenkins yaml file: -------------...
Read more