Questions tagged [amazon-cloudwatch]
Amazon CloudWatch is a monitoring and management service for Amazon-hosted (AWS) cloud applications.
186
questions
14
votes
3
answers
29k
views
Which permissions/policies for IAM role to be used with CloudWatch monitoring script
With CloudWatch monitoring script (mon-put-instance-data.pl) it's possible to specify a IAM role name to provide AWS credentials (--aws-iam-role=VALUE).
I'm creating a IAM role for this purpose (to ...
- 600
13
votes
1
answer
5k
views
Cloudwatch mon-put-instance-data not reporting on AMI-cloned instance
After cloning an EC2 instance using AMI (to change a hosts security group), none of the statistics reported by the Amazon-provided mon-put-instance-data.pl script are showing up in CloudWatch.
I can ...
- 481
13
votes
6
answers
27k
views
Setting up Amazon Cloudwatch to get an alert when you server is down
I have an instance running on Amazon EC2 that I turned into a webserver.
Now I have been looking at cloudwatch, but I do not know if it is the correct tool for the job. Basically I want to get ...
- 11k
13
votes
1
answer
14k
views
Why does top report a different cpu usage than CloudWatch?
top shows an average CPU usage during peak times of about 20% while CloudWatch monitoring shows an average CPU usage of 40%. What causes this discrepancy?
user99751
12
votes
1
answer
3k
views
Why do EC2 T2 instances sometimes start with zero CPU Credits
Can anyone explain why when I launch a new T2.micro instance, it occasionally (perhaps 1 in 50) starts with a CPU credit balance of zero, instead of the 30 it is meant to have?
I've attached ...
- 299
12
votes
2
answers
12k
views
What is the equivalent of 'sudo yum install -y awslogs' for apt-get?
According to aws documentation, this is the command to install the aws-log agent:
sudo yum install -y awslogs
However since I am using ubuntu, I have to use apt-get. But the aws-log package is not ...
- 3,518
12
votes
1
answer
4k
views
Is anyone using an SNMP and/or WMI poller to push custom metrics to Amazon CloudWatch, and if so how?
Amazon CloudWatch has a decent console, and an alarm system which uses Amazon SNS for notifications.
Originally it only gave you AWS metrics, e.g. EC2 instance CPU utilization.
Recently they added ...
- 816
11
votes
3
answers
10k
views
Tail an AWS CloudWatch Log Group
I have a Log Group that includes several Log Streams (from several EC2 instances). Is there any way to simply "tail" the consolidated logs in the group? If I click "Search Events" that shows the ...
- 243
9
votes
1
answer
12k
views
AWS: What is the difference between Burst Balance and EBS IO Balance metrics?
AWS Docs describe Burst Balance and EEBS IO Balance in the following way:
BurstBalance The percent of General Purpose SSD (gp2) burst-bucket I/O
credits available.
EBSIOBalance% The percentage of I/O ...
- 101
9
votes
3
answers
4k
views
Is it possible to get a list of running processes with a Cloudwatch Alarm?
We have an EC2 instance (Ubuntu) that has a few java-based applications and lately we're getting hit with high CPU utilization spikes that trigger one of our Cloudwatch alarms. By the time we get ...
- 247
8
votes
1
answer
9k
views
AWS RDS db.t2 instance performance thresholds & monitoring
We have been rolling out a standard web server configuration for mainstream CMS software like Drupal & WordPress, with the server & storage on EC2 / EBS and the database for those software ...
- 173
7
votes
2
answers
6k
views
How to log AWS SES event details
For some reason I'm having trouble connecting the dots on how to do what seems pretty simple.
How do I log all e-mail sent through the AWS Simple Email Service with specific message details?
That ...
- 3,872
6
votes
2
answers
1k
views
Load Balancing on Amazon (AWS) and staying up to date
I would like to have a load balancer for my site and have the site up to date.
The load balancer will take the AMI I select and spin up more of those instances when processing power hits a certain ...
- 319
6
votes
3
answers
5k
views
AWS S3 bucket size has exploded, but I can't figure out how
Something happened recently with one of our S3 buckets:
I started looking for where all this extra stuff was coming from, but the metrics I gathered don't seem to match what is going on in CloudWatch ...
- 311
6
votes
1
answer
29k
views
CloudWatch InSights: how to extract/query all JSON array elements at once as a list
My company has started using JSON logging in order to better support CloudWatch InSights queries on AWS. The queries are quite easy to work with, except when we are dealing with array data.
For ...
- 275
6
votes
1
answer
1k
views
Are the units incorrect for Storage Read / Write graphs in AWS ECS Container Insights?
In AWS Console > CloudWatch > Container Insights > Performance monitoring > ECS Tasks, the graphs for both Storage Read and Storage Write have units shown as Bytes/Second like this:
...
- 307
6
votes
1
answer
4k
views
create a CloudWatch Alarm when an ECS service unable to consistently start tasks successfully
If I release a new Docker image with a bug to my ECS Service, then the service will attempt to start new Tasks but will keep the old version around if the new tasks fail to start.
In that scenario, it ...
- 744
6
votes
1
answer
470
views
How to stop Lambda from incurring CloudTrail charges related to CreateLogStream?
I manage an actually not very big website, but Lambda is used extensively, invoked many times per site visit, resulting in hundreds of thousands of calls per month.
I noticed a spike in CloudTrail ...
- 1,083
6
votes
3
answers
4k
views
Best way to log to two different CloudWatch log streams from an ECS container?
We are running our services on AWS's ECS platform, and we send our logs to AWS CloudWatch.
We have two types of logs, any container can produce either type:
the usual application logs (access, error,...
- 611
5
votes
2
answers
18k
views
Amazon AWS RDS Burst Balance vs CPU Credit Balance
I'm trying to understand if I have spec'd my database appropriately. Below is a chart showing the WriteIOPS, CPUCreditBalance and BurstBalance for a t3.xlarge instance of SQL Server. It looks like I'm ...
- 153
5
votes
2
answers
2k
views
Why does Amazon EC2 status check succeed for unresponsive instance?
DANGER!
Do not run this command to 'test' it unless you are prepared for a crash and/or force-rebooting your system.
The steps I took:
I created a t1.micro instance on EC2 running Ubuntu 14.01 ...
- 201
5
votes
1
answer
3k
views
Cloudwatch Agent high CPU usage
We are using AWS Cloudwatch to monitor CPU usage, p99 latency for API calls etc. The problem is during peak traffic Amazon Cloudwatch Agent itself is having 25%-35% of CPU usage, thus largely ...
- 51
4
votes
2
answers
967
views
Creating a CloudWatch Scheduled Event with arbitrary data in the `detail` field
I'd like to run a Lambda task on a fixed schedule, with some configuration passed into it by the CloudWatch Scheduled Event that triggers the task. Looking at the documentation here, I can see that ...
- 347
4
votes
1
answer
3k
views
AWS: Why is the bucket size on CloudWatch higher than when using S3 tools?
I use the awscli tools to verify the size of my buckets. First the S3 call (all files without versioning, just an ordinary upload):
$ aws s3 ls s3://XXX --recursive --human-readable --summarize
(...)
...
- 71
4
votes
1
answer
1k
views
Per-instance alarms inside auto-scaling groups in CloudFormation
Basically what it ways on the tin, how can I create individual per-instance alarms inside an auto-scaling group created with a CloudFormation template?
I can reference the ASG itself in an alarm and ...
- 1,794
4
votes
1
answer
5k
views
what is "period" column represent in AWS cloudwatch metric graph?
I created the number metric graph for lambda function like latency, the total number of invocation etc. I also created a custom metric filter which will give me errors and warnings count in logs for ...
- 143
4
votes
1
answer
5k
views
How to schedule an SNS topic
Is there another AWS service that would allow me to publish a Topic to SNS at in an arbitrary date in the future?
I've looked into using Cloudwatch Events but that seems to be more for recurring ...
- 788
4
votes
1
answer
1k
views
Is there a CloudWatch metric that corresponds to ALB data transfer usage/cost?
I have an Application Load Balancer whose data transfer cost I want to monitor.
In Cost Explorer, I can filter on usage type "DataTransfer-Out-Bytes", and see how many GB of data it is ...
- 318
4
votes
1
answer
2k
views
AWS cloudwatch not triggering lambda function
I am trying to create a scheduling system for my EC2 instances using lambda functions to start/shutdown the instances and Cloudwatch to trigger and schedule them.
The problem is Cloudwatch, not ...
- 41
4
votes
2
answers
4k
views
Amazon AWS Elastic Beanstalk EBS Logs To Cloudwatch (Multi Docker Env)
I would like to view all my logs in cloudwatch.
I currently have a multi-docker Elastic beanstalk environment.
I have selected for the logs to push to cloudwatch by going to
Elastic Beanstalk > ...
- 208
4
votes
1
answer
4k
views
Unable to start task in ecs. Tasks are in PENDING state
My tasks are in PENDING status
That's what I can see in the events
There is not many information in the service events.
Here is the task definition in json
{
"requiresAttributes": [
{
...
- 3,518
4
votes
1
answer
669
views
AWS ELB: cloudwatch metric for open connections?
I'm setting up ELB, and I'm having trouble finding a suitable metric to use to adjust the size of the pool.
RequestCount doesn't work because some requests are much cheaper than others.
Latency ...
- 259
3
votes
2
answers
9k
views
Cloudwatch alarms strange behavior
We're implementing some new alarms recently that needs to monitor CPU for 1 min period.
Alarms are acting in very strange way. They show Good status for a min and for the min after they show ...
- 250
3
votes
2
answers
9k
views
How do you get a metric of cloudwatch log group size?
I want to track and alert if my logs go awry. But I can't find a way of tracking the stored bytes for a log group. Is it possible to even add that as a metric?
3
votes
2
answers
4k
views
Cloudformation ELB Cloudwatch Alarms InsufficientData
I have setup a bunch of cloudwatch alarms for my service using cloudformation. All my alarms work except for the ELB alarms. They always just show insufficient data. I can go into the console and ...
- 161
3
votes
1
answer
1k
views
Cloudwatch event for changes in ALB target groups
I have a lambda function that copies the targets (IP addresses in this case) from one target group to another (deleting any in the second target group that don't appear in the first). This gives us 2 ...
- 213
3
votes
2
answers
9k
views
Auto scaling AWS EC2 instances based on memory utilization
I am setting up auto scaling based on memory consumed by the particular instance. I went through the link posted at awsforums. I was able to set my metrics and using the bash script given and with the ...
- 751
3
votes
1
answer
7k
views
AWS EC2 Instance Metadata service fails to respond
Environment, system details, and tools:
AWS EC2
EC2 Instance Metadata service (i.e. http://169.254.169.254/latest/meta-data/)
Cloudwatch
wget
bash
Ubuntu 14.04
Has anyone ever seen this? We have a ...
- 2,638
3
votes
1
answer
888
views
How to monitor the disk space usage of an AWS elasticache redis cluster?
This is the reason behind this question: I am using a redis cluster on AWS Elasticcache as a datastore. I do not enable eviction because I need to keep the data alive inside the redis cluster for as ...
- 3,518
3
votes
1
answer
1k
views
AWS Cloudwatch Pricing, what exactly is a metric and how many data points can you have
Disclaimer: I intended to ask this on the AWS Developer forum, but since I just created a forum account, I "might not be able to post messages for a few hours" and I'll surely be asleep by then and ...
- 99
3
votes
1
answer
3k
views
CodeBuild behind VPC can't access CloudWatch endpoint
I have a CodeBuild project that is setup to use a VPC so it can access RDS. I setup a "VPC Endpoint" for com.amazonaws.us-east-1.s3 so CodeBuild can access CodePipeline output artifacts.
This is ...
- 295
3
votes
1
answer
1k
views
CloudWatch Agent procstat - get status about all nodejs processes separately
I'm trying to get process level monitoring going for an EC2 instance with a bunch of small nodejs services on it.
Right now I am using this configuration:
{
"metrics": {
"...
- 253
3
votes
1
answer
2k
views
How to launch EC2 instance with preconfigured AWS Alarm
I wan't to kill a specific instance when some of it's hardware consumption metrics reaches a certain level. If i create an alarm for the scaling group (setting maximum cpu consumption threshhold to >=...
- 171
3
votes
1
answer
3k
views
AWS CloudWatch Dashboard for Large Screen Display with Alerting
Does anyone know of a good solution that provides a monitoring and alerting Dashboard for Amazon Web Servics (AWS) CloudWatch service which can used on large screen displays?
The system should use ...
- 91
3
votes
0
answers
2k
views
How to show instance names in CloudWatch graph labels?
We have a couple of machines in AWS EC2 and are running the Amazon CloudWatch Agent on them to collect metrics. Instead of the default ImageId, InstanceId, InstanceType triplet, the agent is ...
- 811
3
votes
0
answers
2k
views
How can I count EC2 instances over time in AWS?
I want to know the number of EC2 instances I have running over time. I am able to view this data from the following menu:
ec2 dashboard
Auto Scaling Groups
select my group from the table of groups
...
- 131
3
votes
2
answers
2k
views
AWS Route53 - Getting simple metrics such as "number of requests in the last 24hrs"
My goal is to get a simple "# of requests per day" value against a Route 53 hosted zone.
I see no straightforward way to do this.
I have created the query logging as explained here: https://docs....
- 2,307
3
votes
2
answers
421
views
Cloudwatch logs - audit user access
I have a list of users in .passwd and access_log being uploaded to Cloudwatch.
I need to make weekly report who from this list did access to server.
Is there any way to automate this rather than ...
- 31
3
votes
0
answers
1k
views
Deploying CloudWatch Agent Config to Elastic Beanstalk
I have two environments (production, staging) within an Elastic Beanstalk environment and wanted to set up CloudWatch Agent logging for the EC2 instances being used with these environments. When ...
- 197
3
votes
1
answer
564
views
archive and visualize amazon ec2 cloudwatch metrics
How do you backup your ec2 cloudwatch metrics? How do you visualize different measurements with different scales at once, like cpu% and i/o? How do you combine your application server metrics (like '...
- 131