Questions tagged [amazon-ebs]
This is for questions on Amazon's storage service for its ec2 service.
577
questions
128
votes
4
answers
60k
views
Amazon EC2 terminology - AMI vs. EBS vs. Snapshot vs. Volume
I have been poking around Amazon EC2, and am a little confused on some of the terminology. Specifically with regard to AMI, snapshots and volumes, and an EBS
Please correct me if I am wrong, or fill ...
42
votes
2
answers
27k
views
Safe to Use an Amazon EBS Volume While Snapshot in Progress?
Is it safe to use an EBS volumne while a snapshot is being created?
I've currently got a 100Gb EBS volume mounted. I am in the process of snapshotting it. Goodness it's slow!! It's going to end up ...
40
votes
2
answers
61k
views
How do I access the attached volume in Amazon EC2
I just attached another ebs volume to running instance. But how do I access the volume? I can't find the /dev/sda directory anywhere. Where should I look?
38
votes
6
answers
58k
views
How to increase disk size in a stateful set
I'm managing an Elasticsearch deployment in Kubernetes. I see that the disk storage is getting close to full, so I would like to increase the size of the persistent volumes.
I want to change this ...
34
votes
3
answers
41k
views
EBS vs SSD definition
I am confused about the EBS and SSD choice while creating an instance .
while choosing instance parameters (Step 2) you will see 2 options in the column Instance Storage (GB) : EBS only or SSD .
...
27
votes
2
answers
25k
views
How to convert a unencrypted EBS to be encrypted
I have a number of older EBS volumes that are not encrypted. In satisfying new corporate security measures, all data needs to be "encrypted at rest" so I need to convert all of the volumes to be ...
26
votes
6
answers
45k
views
How to reduce AWS EBS root volume size?
Enlarging an EC2 instance is easy like a breath (for instance, create an AMI, launch an instance from it and then change the storage size).
But reducing it becomes more difficult. I’d like to reduce ...
26
votes
2
answers
18k
views
How to determine actual size of an amazon snapshot?
Amazon EBS snapshots capture changed blocks from a baseline, so snapshots will often be much smaller than the source volume. Billing is based on the actual size, which is nice. However, I cannot find ...
25
votes
4
answers
2k
views
Amazon EC2 Data Persistence
According to the Amazon EC2 FAQ, when an instance is terminated the data is gone. What steps can I take to preserve data in the event my instance is rebooted? I've been looking into EBS and S3 - would ...
25
votes
3
answers
12k
views
Shrinking Amazon EBS volume size
I have seen this answer for growing EBS volumes, but I would like to shrink one.
The default Ubuntu Server images are 15 GB while I really need only 2 GB max (I use a different volume for data). Is ...
24
votes
1
answer
32k
views
Creating an EC2 AMI Image from a running instance vs. from a volume snapshot
I want to backup a Linux-based EC2 instance while it is running with no downtime, and then later on launch a new instance. (The instance is running a web server and Postgres database.)
I found there ...
20
votes
2
answers
20k
views
Booting an EC2 instance from an existing EBS volume
I'm just getting up to speed on AWS and had a question about using an existing EBS volume as a boot device for an EC2 instance.
It looks like a lot of the instances create an EBS volume for their ...
19
votes
4
answers
16k
views
EC2 drive not EBS volume size
I have an EC2 instance which I created a 500GB EBS volume for. Unfortunately, the EC2 instance shows only 8GB available.
I have only one drive, which is right.
[root@ip-10-244-134-250 ~]# ls -la /...
19
votes
3
answers
18k
views
Can I re-use an EBS volume with AWS ASG?
I want to create an ASG such that I can reuse existing EBS volumes (because I have persistent data on those volumes) to new EC2 instances that are instantiated via ASG. Is this possible?
Update ...
18
votes
4
answers
45k
views
Is it possible to change the EBS volume to different availability zones?
I have a server created in "eu-west-1c" availability zone and I tried to attach the volume created in "eu-west-1a" availability zone to "eu-west-1c" but the server created in "eu-west-1c" is not ...
18
votes
2
answers
3k
views
Which AWS features are EBS backed?
I recently read an article AWS: The good, the bad and ugly, which mentioned that they've moved off of all EBS backed AWS features. What features are explicity (EBS backed EC2 instances) or implicitly (...
17
votes
4
answers
33k
views
Fastest time to get an EC2 instance running
I am considering moving from a VPS to EC2.
EC2 is elastic and so is its pricing; I could boot my instance on demand, then let it shut down if it isn't active by the end of some hourly period.
How ...
16
votes
4
answers
14k
views
Auto-Attach EBS-volume to a New Spot Instance?
I am experimenting with EC2 spot instances, and am needing some data to be retained between terminations. Now as I understand it, when the current price goes above my max. bid, it will be ...
16
votes
5
answers
33k
views
Download EBS volume or snapshot to file
Is there any way to dump/save EBS volume/snapshot to file or mount it to local Linux file-system?
I found only this old thread and this script which intends to save it via S3 and doesn't seem very ...
14
votes
1
answer
20k
views
Where's my ephemeral storage for EC2 Instance
I have looked through the following questions, notably How to use "Instance Store Volumes" storage in Amazon EC2?
However, it didn't answer. I created a EC2 small instance with EBS as the ...
13
votes
4
answers
7k
views
How are Amazon EBS snapshot's sizes calculated?
First, how can I retrieve the space consumed by my EBS snapshots?
Second, according to the documentation, Amazon EBS snapshot only backs up the blocks of an EBS volume that have been modified since ...
12
votes
5
answers
12k
views
Which is faster for read access on EC2; local drive or EBS?
Which is faster for read access on an EC2 instance; the "local" drive or an attached EBS volume?
I have some data that needs to be persisted so have placed this on an EBS volume. I'm using ...
12
votes
3
answers
26k
views
how to get volume id attached to instance from AWS CLI
i want to get volume id attached to instance like how we get instance id from the meta data
InstanceID=`curl http://169.254.169.254/latest/meta-data/instance-id
12
votes
3
answers
11k
views
Amazon EBS charges calculation
How/when does Amazon calculate how much I will have to pay for EBS?
I accidentally created a 100 GiB EBS volume and deleted it after 20 mins when I realized what I had done, does it mean I will be ...
12
votes
3
answers
8k
views
Simple Backup Strategy for Amazon EC2 instances / volumes?
You have entered Introductory Backups for Amazon EC2 EBS-backed Windows Images 010...
I have been browsing my brains out to find a simple backup strategy for our single windows 2008 server running ...
11
votes
2
answers
8k
views
Disk root error on start instance on "Amazon Web Services (AWS)" EC2
I "Detach Volume" and "Attach Volume" again.
After that I want "Instance Start" but I get immediately message
Error starting instances
Invalid value 'i-{id}' for instanceId. Instance does not ...
11
votes
5
answers
13k
views
how do I find out what part of my ec2 storage is ephemeral
This may be a silly question, excuse my ignorance.
I have an instance running like this:
Does Root Device : EBS mean my entire system is on EBS?
I've configured apache and a perl app here, all my ...
10
votes
3
answers
2k
views
Should a detached EBS volume keep charging monthly?
First of all, I'm not very used to AWS nor DevOps/admin stuff, but want to learn. So I set up an EC2 instance and attached an EBS volume (15 Gb) some months ago, for testing something during a few ...
10
votes
4
answers
10k
views
Copying an EBS Snapshot to S3 for low-cost storage
Goal: Be able to copy an EBS snapshot to S3 and have it be treated like an arbitrary object that I could download to a local on-prem machine if I so wished.
I understand that EBS Snapshots are ...
10
votes
3
answers
12k
views
Root Device on SSD instance types. SSD vs EBS confusion
I have an AMI that was originally created from a t1.micro linux. The "Root Device Type" of this AMI is EBS (8 GB) and my web application software is "baked" into this root volume.
Now I would like to ...
10
votes
1
answer
3k
views
At what point is EBS usage the bottleneck?
I've got a site hosted on Amazon using a EC2 instance backed by an EBS volume. On the weekends, traffic spikes and I make the instance larger which helps quite a bit -- I'm no longer seeing CPU usage ...
9
votes
4
answers
16k
views
Mounting an attached ebs volume in EC2
I've created an EC2 instance, created an EBS volume, attached it to the running instance, and successfully ssh'ed into my instance.
The drive is attached as /dev/sdf
Next, I tried mounting the drive ...
9
votes
1
answer
6k
views
Redis reports read-only filesystem, but it isn't
I get this in my Redis logs:
1182:M 30 Nov 14:27:00.028 * 1 changes in 900 seconds. Saving...
1182:M 30 Nov 14:27:00.029 * Background saving started by pid 1920
1920:C 30 Nov 14:27:00.029 # Failed ...
9
votes
1
answer
13k
views
Why is my AWS instance not reachable?
Yesterday, I created a new instance but I cannot connect to it. Tried pinging it from my computer, online ping sites etc but it is just not reachable.
In the AWS console. everything seems to be ...
9
votes
1
answer
1k
views
5.5GB written daily to 1.2GB root volume - 4 times previous levels
Problem:
I recently revamped one of my servers, it was tested prior to use, and functions well, however, a few days ago, I noticed approximately 4 times the usual amount of writes to the root volume. ...
9
votes
2
answers
10k
views
df shows disk full but ncdu shows only 1.5gb of 8gb used [duplicate]
I am confused. Our EC2 instance is showing that the disk is 98% full. The output from df -Th shows:
Filesystem Type Size Used Avail Use% Mounted on
/dev/xvda1 ext4 7.9G 7.7G 172M 98% /...
9
votes
1
answer
12k
views
AWS: What is the difference between Burst Balance and EBS IO Balance metrics?
AWS Docs describe Burst Balance and EEBS IO Balance in the following way:
BurstBalance The percent of General Purpose SSD (gp2) burst-bucket I/O
credits available.
EBSIOBalance% The percentage of I/O ...
9
votes
2
answers
5k
views
EC2 - Shared Storage - S3FS or EBS?
Building my web service onto EC2 right now and have a single instance behind a load balancer. I will of course cater for multiple instances.
My initial idea was to run all the instances a dumb slaves,...
8
votes
6
answers
13k
views
How do I mount an EBS root volume to a windows instance in Amazon EC2
So basically, I created a large windows server for development, and then I created a micro windows server for production. I set up everything how I wanted it on my development server, and then i ...
8
votes
5
answers
31k
views
How can I set up an SFTP server backed by S3 (or similar)
I need to set up an SFTP server that, essentially, has very large capacity. I need to give one of our partners SFTP login details to a server where they will upload millions of files, totalling a few ...
8
votes
3
answers
3k
views
Restoring an Amazon EBS RAID0 array from snapshots taken with ec2-consistent-snapshot
I've configured a new MySQL server on Amazon EC2 and decided to store my data on a EBS RAID0 Array. So far so good, and I've tested taking snapshots of those devices with ec2-consistent-snapshot, ...
8
votes
1
answer
3k
views
How can I access instance storage on a Windows EC2 instance with an ebs root device?
I have created an AMI, but I would like to use instance storage for some scientific programs I want to run. They basically read a bunch of stuff from disk, write it back out to disk and then ...
8
votes
4
answers
12k
views
How to create EBS based EC2 AMI from scratch?
after Amazon announced the new EBS based AMIs, I'm wondering if it is or will be possible to create new AMIs that are not based on the existing Fedora/Windows AMIs. The documentation says:
The ...
8
votes
2
answers
3k
views
Amazon EC2 Spot Instances very slow at getting accepted/starting
I've recently made a new Ubuntu EBS image on Amazon EC2 and since what I am running isn't of the utmost importance, have decided to run it as a spot instance to take advantage of the lower pricing. ...
7
votes
1
answer
8k
views
Created an EBS volume from a snapshot, but can't mount it?
fdisk -l shows the volume so it looks like it's attached but when I follow these steps
echo "/dev/xvdg /vol2 xfs noatime 0 0" | sudo tee -a /etc/fstab
sudo mkdir /vol2
sudo mount /vol2
I get the ...
7
votes
4
answers
5k
views
are EBS volumes wiped after use?
I tried to recover some data from an ebs volume on which I accidentally ran wipefs on.
I used PhotoRec (http://www.cgsecurity.org/wiki/PhotoRec)... and it got my files back but also a ton of other ...
7
votes
2
answers
7k
views
Is RAID 1 overkill on Amazon EBS drives in terms of reliability?
My thinking behind this is that RAID 1 creates two or more copies of the data on multiple EBS drives. Yet, aren't Amazon EBS disks virtually fail-safe because they live on multiple physical drives? So ...
7
votes
4
answers
4k
views
Software RAID10 for later growth
I'm wondering what the best practice is for creating RAID10 in software on Linux with the ability to later grow by adding disks or expanding volumes underneath.
I'm using EBS on Amazon, I want to ...
7
votes
6
answers
9k
views
Amazon EC2 instance won't boot: Kernel panic - not syncing: VFS: Unable to mount root fs on unknown-block(0,0)
My instance was running for years and suddenly stopped responding Jun 1st. I tried to reboot it, but it would not boot. It gave errors in the system log: https://pastebin.com/rSxr1kLs
Linux version ...
7
votes
1
answer
5k
views
What happens when I delete the first of several AWS EBS snapshots?
On http://aws.amazon.com/ebs/pricing/
it says:
"EBS Snapshots
[...] For the first snapshot of a volume, Amazon EBS saves a full copy of your data to Amazon S3. For each incremental snapshot, only ...