Working with Amazon S3

To run the sample

1. Open the AwsCredentials.properties file, which is in the same directory as the sample file.

   For example, the Console sample file is located at aws-java-sdk/samples/AwsConsoleApp/AwsCredentials.properties.

2. Locate the following section and fill in your Access Key ID and Secret Access Key:

   # Fill in your AWS Access Key ID and Secret Access Key
   # http://aws.amazon.com/security-credentials
   accessKey = AccessKeyid
   secretKey = SecretKey

3. Save the file.

4. Open the sample file and replace my-first-s3-bucket with the bucket name to create.

   String bucketName = "my-first-s3-bucket-" + UUID.randomUUID();

5. Run the sample.

   System.out.println("Creating bucket " + bucketName + "\n");
   s3.createBucket(bucketName);

To run the sample

1. Open the sample file.

2. Replace bucket-name with the bucket name to create. Also, replace secretKeyID and secretAccessKeyID with your personal values.

   static void CreateABucket()
     {
         // all future examples assume this:
         AmazonS3 client = Amazon.AWSClientFactory.CreateAmazonS3Client(secretKeyID, secretAccessKeyID);
         try
         {
             PutBucketRequest request = new PutBucketRequest();
             request.BucketName = "[bucket-name]";
             S3Response response = client.PutBucket(request);
             // Do something with the response 
   
             response.Dispose();
         }
         catch (AmazonS3Exception ex)
         {
             // something bad happened
         }
     }

To run the sample

1. Open the sample file.

2. Replace bucket-name with the bucket name to create.

   # all future examples assume this:
   my $conn =
       S3::AWSAuthConnection->new("[aws-access-key-id]", "[aws-secret-access-key]");
   
   my $response = $conn->create_bucket("[bucket-name]");
   if ($response->http_response->code == 200) {
       # bucket was created
   } else {
       # something bad happened
   }

To run the sample

1. Open the sample file.

2. Replace bucket-name with the bucket name to create.

   $req =& new HTTP_Request("http://s3.amazonaws.com/[bucket-name]");
   $req->setMethod("PUT");
   setAuthorizationHeader($req);
   $req->sendRequest();
   
   if ($req->getResponseCode() == 200) {
       // bucket was created
   } else {
       // something bad happened
   }

To run the sample

1. Open the sample file.

2. Replace bucket-name with the bucket name to create.

   # all future examples assume this:
   conn =
       S3::AWSAuthConnection.new("[aws-access-key-id]", "[aws-secret-access-key]")
   
   response = conn.create_bucket("[bucket-name]")
   if response.http_response.code == 200
       # bucket was created
   else
       # something bad happened
   end

To run the sample

1. Open the sample file.

2. Replace bucket-name with the bucket name to create.

   # all future examples assume this:
   conn = S3.AWSAuthConnection("[aws-access-key-id]", "[aws-secret-access-key]")
   
   response = conn.create_bucket("[bucket-name]")
   if response.http_response.status == 200:
       # bucket was created
   else:
       # something bad happened

To run the sample

1. Open the AwsCredentials.properties file, which is in the same directory as the sample file.

   For example, the Console sample file is located at aws-java-sdk/samples/AwsConsoleApp/AwsCredentials.properties.

2. Locate the following section and fill in your Access Key ID and Secret Access Key:

   # Fill in your AWS Access Key ID and Secret Access Key
   # http://aws.amazon.com/security-credentials
   accessKey = AccessKeyid
   secretKey = SecretKey

3. Save the file.

4. Run the sample.

   System.out.println("Listing buckets");
   for (S3Bucket bucket : s3.listBuckets()) {
        System.out.println(" - " + bucket.getName());
   }
   System.out.println();
                       

To run the sample

1. Open the AwsCredentials.properties file, which is in the same directory as the sample file.

   For example, the Console sample file is located at aws-java-sdk/samples/AwsConsoleApp/AwsCredentials.properties.

2. Locate the following section and fill in your Access Key ID and Secret Access Key:

   # Fill in your AWS Access Key ID and Secret Access Key
   # http://aws.amazon.com/security-credentials
   accessKey = AccessKeyid
   secretKey = SecretKey

3. Save the file.

4. Open the sample and replace my-first-s3-bucket with the name of the bucket you own.

   String bucketName = "my-first-s3-bucket-" + UUID.randomUUID();

5. Use the following sample to delete the bucket specified by bucketName.

   System.out.println("Deleting bucket " + bucketName + "\n");
   s3.deleteBucket(bucketName);
           } catch (AmazonServiceException ase) {
   System.out.println("Caught an AmazonServiceException, which means your request made it "
           + "to Amazon S3, but was rejected with an error response for some reason.");
   System.out.println("Error Message:    " + ase.getMessage());
   System.out.println("HTTP Status Code: " + ase.getStatusCode());
   System.out.println("AWS Error Code:   " + ase.getErrorCode());
   System.out.println("Error Type:       " + ase.getErrorType());
   System.out.println("Request ID:       " + ase.getRequestId());
           } catch (AmazonClientException ace) {
   System.out.println("Caught an AmazonClientException, which means the client encountered "
           + "a serious internal problem while trying to communicate with S3, "
           + "such as not being able to access the network.");
   System.out.println("Error Message: " + ace.getMessage());
       }
   }

To run the sample

1. Open the AwsCredentials.properties file, which is in the same directory as the sample file.

   For example, the Console sample file is located at aws-java-sdk/samples/AwsConsoleApp/AwsCredentials.properties.

2. Locate the following section and fill in your Access Key ID and Secret Access Key:

   # Fill in your AWS Access Key ID and Secret Access Key
   # http://aws.amazon.com/security-credentials
   accessKey = AccessKeyid
   secretKey = SecretKey

3. Save the file.

4. Open the sample file and replace my-first-s3-bucket with the bucket name to create.

   String bucketName = "my-first-s3-bucket-" + UUID.randomUUID();

5. Replace MyObjectKey with the name of an object you want to upload into Amazon S3.

6. Run the sample.

   System.out.println("Uploading a new object to S3 from a file\n");
   s3.putObject(new PutObjectRequest(bucketName, key, createSampleFile()));
   

To run the sample

1. Open the sample file.

2. Replace [bucket-name] with the name of your bucket and [key-name] with the name of the object. Also, replace secretKeyID and secretAccessKeyID with your personal values.

3. Make any changes and run the sample.

   static void WritingAnObject()
     {
         // all future examples assume this:
         AmazonS3 client = Amazon.AWSClientFactory.CreateAmazonS3Client(secretKeyID, secretAccessKeyID);
   
         // simple object put
         PutObjectRequest request = new PutObjectRequest();
         request.WithContentBody("this is a test")
             .WithBucketName("[bucket-name]")
             .WithKey("[key-name]");
   
         S3Response response = client.PutObject(request);
   
         // put a more complex object with some metadata and http headers.
         PutObjectRequest titledRequest = new PutObjectRequest();
         titledRequest.WithMetaData("title", "my title")
             .WithContentBody("this object has a title")
             .WithBucketName("[bucket-name]")
             .WithKey("[key-name]");
   
         response = client.PutObject(titledRequest);
         //Read response
   
         response.Dispose();
     }

To run the sample

1. Open the sample file.

2. Replace [bucket-name] with the name of your bucket and [key-name] with the name of the object.

3. Make any changes and run the sample.

   # simple object put
   my $response =
       $conn->put("[bucket-name]", "[key-name]", S3Object->new("this is a test"));
   
   # put a more complex object with some metadata and http headers.
   $response =
        $conn->put(
           "[bucket-name]",
           "[key-name]",
           S3Object->new("this is a test", { title => "my title" }),
           { "Content-Type" => "text/plain" });

To run the sample

1. Open the sample file.

2. Replace [bucket-name] with the name of your bucket and [key-name] with the name of the object.

3. Make any changes and run the sample.

   $req =& new HTTP_Request("http://s3.amazonaws.com/[bucket-name]/[object-name]");
   $req->setMethod("PUT");
   $req->setBody("this is a test");
   $req->setHeader("Content-Type", "text/plain");
   $req->setHeader("x-amz-meta-title", "my title");
   setAuthorizationHeader($req);
   $req->sendRequest();

To run the sample

1. Open the sample file.

2. Replace [bucket-name] with the name of your bucket and [key-name] with the name of the object.

3. Make any changes and run the sample.

   # simple object put
   conn.put("[bucket-name]", "[key-name]", S3::S3Object.new("this is a test"));
   
   # put a more complex object with some metadata and http headers.
   $conn->put(
       "[bucket-name]",
       "[key-name]",
       S3::S3Object.new("this is a test", { "title" => "my title" }),
       { "Content-Type" => "text/plain" })

To run the sample

1. Open the sample file.

2. Replace [bucket-name] with the name of your bucket and [key-name] with the name of the object.

3. Make any changes and run the sample.

   # simple object put
   conn.put("[bucket-name]", "[key-name]", S3.S3Object("this is a test"));
   
   # put a more complex object with some metadata and http headers.
   $conn->put(
       "[bucket-name]",
       "[key-name]",
       S3.S3Object("this is a test", { "title": "my title" })
       { "Content-Type": "text/plain" })

To run the sample

1. Open the AwsCredentials.properties file, which is in the same directory as the sample file.

   For example, the Console sample file is located at aws-java-sdk/samples/AwsConsoleApp/AwsCredentials.properties.

2. Locate the following section and fill in your Access Key ID and Secret Access Key:

   # Fill in your AWS Access Key ID and Secret Access Key
   # http://aws.amazon.com/security-credentials
   accessKey = AccessKeyid
   secretKey = SecretKey

3. Save the file.

4. Open the sample file and replace my-first-s3-bucket with the bucket name to create.

   String bucketName = "my-first-s3-bucket-" + UUID.randomUUID();

5. Run the sample.

   System.out.println("Listing objects");
   S3ObjectListing objectListing = s3.listObjects(new ListObjectsRequest()
   .withBucketName(bucketName)
   .withPrefix("My"));
   for (S3ObjectSummary objectSummary : objectListing.getObjectSummaries()) {
        System.out.println(" - " + objectSummary.getKey() + "  " + 
        "(size = " + objectSummary.getSize() + ")");
   }
   System.out.println();        

To run the sample

1. Open the sample file.

2. Replace [bucket-name] with the name of your bucket. Also, replace secretKeyID and secretAccessKeyID with your personal values.

3. Use the following sample to test different list operations.

   static void ListingObjects()
     {
         // all future examples assume this:
         AmazonS3 client = Amazon.AWSClientFactory.CreateAmazonS3Client(secretKeyID, secretAccessKeyID);
   
         // simple list
         ListObjectsRequest request = new ListObjectsRequest();
         request.BucketName = "[bucket-name]";
         
         ListObjectsResponse response = client.ListObjects(request);
         foreach (S3Object entry in response.S3Objects)
         {
             Console.WriteLine("key = {0} size = {1}", entry.Key, entry.Size);
         }
   
         // list only things starting with "foo"
         request.WithPrefix("foo");
         response = client.ListObjects(request);
         
         // list only things that come after "bar" alphabetically
         request.WithPrefix("")
             .WithMarker("bar");
         response = client.ListObjects(request);
         
         // only list 3 things
         request.WithPrefix("")
             .WithMarker("")
             .WithMaxKeys("3");
         response = client.ListObjects(request);
   
         response.Dispose();
   
     }
   

To run the sample

1. Open the sample file.

2. Replace bucket-name with the name of your bucket.

3. Use the following sample to test different list operations.

   # simple list
   my $response = $conn->list_bucket("[bucket-name]");
   
   foreach my $entry (@{$response->entries}) {
       print "key = $entry->{Key} size = $entry->{Size}\n";
   }
   
   # list only things starting with "foo"
   $response = $conn->list_bucket("[bucket-name]", {prefix => "foo"});
   
   # list only things that come after "bar" alphabetically
   $response = $conn->list_bucket("[bucket-name]", {marker => "bar"});
   
   # only list 3 things
   $response = $conn->list_bucket("[bucket-name]", {"max-keys" => 3});

To run the sample

1. Open the sample file.

2. Replace bucket-name with the name of your bucket.

3. Use the following sample to test different list operations.

   $req =& new HTTP_Request("http://s3.amazonaws.com/[bucket-name]");
   $req->setMethod("GET");
   setAuthorizationHeader($req);
   $req->sendRequest();
   
   if ($req->getResponseCode() == 200) {
       $listXml = $req->getResponseBody();
   } else {
       // something bad happened
   }
   
   // list only things starting with "foo"
   $req =& new HTTP_Request("http://s3.amazonaws.com/[bucket-name]/?prefix=foo");
   ...
   
   // list only things that come after "bar" alphabetically
   $req =& new HTTP_Request("http://s3.amazonaws.com/[bucket-name]/?marker=bar");
   ...
   
   # only list 3 things
   $req =& new HTTP_Request("http://s3.amazonaws.com/[bucket-name]/?max-keys=3");

To run the sample

1. Open the sample file.

2. Replace bucket-name with the name of your bucket.

3. Use the following sample to test different list operations.

   response = conn.list_bucket("[bucket-name]");
   
   response.entries.each do |entry|
       print "key = #{entry.key} size = #{entry.size}\n"
   end
   
   # list only things starting with "foo"
   response = conn.list_bucket("[bucket-name]", {"prefix" => "foo"});
   
   # list only things that come after "bar" alphabetically
   response = conn.list_bucket("[bucket-name]", {"marker" => "bar"});
   
   # only list 3 things
   response = conn.list_bucket("[bucket-name]", {"max-keys" => "3"});

To run the sample

1. Open the sample file.

2. Replace bucket-name with the name of your bucket.

3. Use the following sample to test different list operations.

   # simple list
   response = conn.list_bucket("[bucket-name]");
   
   for entry in response.entries:
       print "key = %s size = %d" % (entry.key, entry.size)
   
   # list only things starting with "foo"
   response = conn.list_bucket("[bucket-name]", {"prefix": "foo"});
   
   # list only things that come after "bar" alphabetically
   response = conn.list_bucket("[bucket-name]", {"marker": "bar"});
   
   # only list 3 things
   response = conn.list_bucket("[bucket-name]", {"max-keys" => "3"});

To run the sample

1. Open the AwsCredentials.properties file, which is in the same directory as the sample file.

   For example, the Console sample file is located at aws-java-sdk/samples/AwsConsoleApp/AwsCredentials.properties.

2. Locate the following section and fill in your Access Key ID and Secret Access Key:

   # Fill in your AWS Access Key ID and Secret Access Key
   # http://aws.amazon.com/security-credentials
   accessKey = AccessKeyid
   secretKey = SecretKey

3. Save the file.

4. Open the sample file and replace my-first-s3-bucket with the bucket name to create.

   String bucketName = "my-first-s3-bucket-" + UUID.randomUUID();

5. Replace MyObjectKey with the name of an object you want to read from Amazon S3.

6. Run the sample.

   GetResponse response = conn.get("[bucket-name]", "[key-name]", null);
   String value = response.object.data;
   Map metadata = response.object.metadata;
   List values = (List)metadata.get("title");
   String title = (String)values.get(0);

To run the sample

1. Open the sample file.

2. Replace [bucket-name] with the name of your bucket and [key-name] with the name of the EC2 key pair name. Also, replace secretKeyID and secretAccessKeyID with your personal values.

   static void ReadingAnObject()
   {
       // all future examples assume this:
       AmazonS3 client = Amazon.AWSClientFactory.CreateAmazonS3Client(secretKeyID, secretAccessKeyID);
   
       GetObjectRequest request = new GetObjectRequest().WithBucketName("[bucket-name").WithKey("[key-name]");
       //Consider calling client.GetObjectMetadata so only metadata is brought back
       S3Response response = client.GetObject(request);
       
       string title = response.Metadata["title"];
   
       response.Dispose();
   }
   

To run the sample

1. Open the sample file.

2. Replace bucket-name with the name of your bucket and key-name with the name of the object to read.

   my $response = $conn->get("[bucket-name]", "[key-name]");
   my $data = $response->object->data;
   my $metadata = $response->object->metadata;
   my $title = $metadata->{title};

To run the sample

1. Open the sample file.

2. Replace bucket-name with the name of your bucket and key-name with the name of the object to read.

   $req =& new HTTP_Request("http://s3.amazonaws.com/[bucket-name]/[key-name]");
   $req->setMethod("GET");
   setAuthorizationHeader($req);
   $req->sendRequest();
   
   if ($req->getResponseCode() == 200) {
       $data = $req->getResponseBody();
   } else {
       // something bad happened
   }

To run the sample

1. Open the sample file.

2. Replace bucket-name with the name of your bucket and key-name with the name of the object to read.

   response = conn.get("[bucket-name]", "[key-name]");
   data = response.object.data
   metadata = response.object.metadata
   title = metadata["title"]

To run the sample

1. Open the sample file.

2. Replace bucket-name with the name of your bucket and key-name with the name of the object to read.

   response = conn.get("[bucket-name]", "[key-name]");
   data = response.object.data
   metadata = response.object.metadata
   title = metadata["title"]

To run the sample

1. Open the AwsCredentials.properties file, which is in the same directory as the sample file.

   For example, the Console sample file is located at aws-java-sdk/samples/AwsConsoleApp/AwsCredentials.properties.

2. Locate the following section and fill in your Access Key ID and Secret Access Key:

   # Fill in your AWS Access Key ID and Secret Access Key
   # http://aws.amazon.com/security-credentials
   accessKey = AccessKeyid
   secretKey = SecretKey

3. Save the file.

4. Open the sample file and replace my-first-s3-bucket with the bucket name to create.

   String bucketName = "my-first-s3-bucket-" + UUID.randomUUID();

5. Replace MyObjectKey with the name of an object you want to delete from Amazon S3.

6. Run the sample.

   System.out.println("Deleting bucket " + bucketName + "\n");
   s3.deleteBucket(bucketName);
           } catch (AmazonServiceException ase) {
   System.out.println("Caught an AmazonServiceException, which means your request made it "
           + "to Amazon S3, but was rejected with an error response for some reason.");
   System.out.println("Error Message:    " + ase.getMessage());
   System.out.println("HTTP Status Code: " + ase.getStatusCode());
   System.out.println("AWS Error Code:   " + ase.getErrorCode());
   System.out.println("Error Type:       " + ase.getErrorType());
   System.out.println("Request ID:       " + ase.getRequestId());
           } catch (AmazonClientException ace) {
   System.out.println("Caught an AmazonClientException, which means the client encountered "
           + "a serious internal problem while trying to communicate with S3, "
           + "such as not being able to access the network.");
   System.out.println("Error Message: " + ace.getMessage());
           }
       }

To run the sample

1. Open the sample file.

2. Replace bucket-name with the name of your bucket and key-name with the name of the object to delete.

   static void DeletingAnObject()
   {
       // all future examples assume this:
       AmazonS3 client = Amazon.AWSClientFactory.CreateAmazonS3Client(secretKeyID, secretAccessKeyID);
   
       try
       {
           DeleteObjectRequest request = new DeleteObjectRequest();
           request.WithBucketName("[bucket-name]")
               .WithKey("[key-name]");
           DeleteObjectResponse response = client.DeleteObject(request);
           response.Dispose();
       }
       catch (AmazonS3Exception ex)
       {
           // Something bad happened
       }
   }
   
   

To run the sample

1. Open the sample file.

2. Replace bucket-name with the name of your bucket and key-name with the name of the object to delete.

   $conn->delete("[bucket-name]", "[key-name]");
   
   if ($response->http_response->code == 204) {
       # object was deleted
   } else {
       # something bad happened
   }

To run the sample

1. Open the sample file.

2. Replace bucket-name with the name of your bucket and key-name with the name of the object to delete.

   $req =& new HTTP_Request("http://s3.amazonaws.com/[bucket-name]/[key-name]");
   $req->setMethod("DELETE");
   setAuthorizationHeader($req);
   $req->sendRequest();
   
   if ($req->getResponseCode() == 204) {
       // bucket was deleted
   } else {
       // something bad happened
   }

To run the sample

1. Open the sample file.

2. Replace bucket-name with the name of your bucket and key-name with the name of the object to delete.

   conn.delete("[bucket-name]", "[key-name]");
   if response.http_response.status == 204
     # object was deleted
   else
     # something bad happened
   end

To run the sample

1. Open the sample file.

2. Replace bucket-name with the name of your bucket and key-name with the name of the object to delete.

   conn.delete("[bucket-name]", "[key-name]");
   if response.http_response.status == 204:
       # object was deleted
   else:
       # something bad happened

To run the sample

1. Open the AwsCredentials.properties file, which is in the same directory as the sample file.

   For example, the Console sample file is located at aws-java-sdk/samples/AwsConsoleApp/AwsCredentials.properties.

2. Locate the following section and fill in your Access Key ID and Secret Access Key:

   # Fill in your AWS Access Key ID and Secret Access Key
   # http://aws.amazon.com/security-credentials
   accessKey = AccessKeyid
   secretKey = SecretKey

3. Save the file.

4. Open the sample file and replace my-first-s3-bucket with the bucket name to create.

   String bucketName = "my-first-s3-bucket-" + UUID.randomUUID();

5. Replace MyObjectKey with the name of an object you want to upload into Amazon S3.

6. Use the following sample to test different list operations.

   private static File createSampleFile() throws IOException {
       File file = File.createTempFile("aws-java-sdk-", ".txt");
       file.deleteOnExit();
   
       Writer writer = new OutputStreamWriter(new FileOutputStream(file));
       writer.write("abcdefghijklmnopqrstuvwxyz\n");
       writer.write("01234567890112345678901234\n");
       writer.write("!@#$%^&*()-=[]{};':',.<>/?\n");
       writer.write("01234567890112345678901234\n");
       writer.write("abcdefghijklmnopqrstuvwxyz\n");
       writer.close();
       
       return file;
   }
   

   The return is a newly created temporary file that contains text data.

To run the sample

1. Open the AwsCredentials.properties file, which is in the same directory as the sample file.

   For example, the Console sample file is located at aws-java-sdk/samples/AwsConsoleApp/AwsCredentials.properties.

2. Locate the following section and fill in your Access Key ID and Secret Access Key:

   # Fill in your AWS Access Key ID and Secret Access Key
   # http://aws.amazon.com/security-credentials
   accessKey = AccessKeyid
   secretKey = SecretKey

3. Save the file.

4. Open the sample file and replace my-first-s3-bucket with the bucket name to create.

   String bucketName = "my-first-s3-bucket-" + UUID.randomUUID();

5. Replace MyObjectKey with the name of an object you want to upload into Amazon S3.

6. In the following code sample, set input to the text you want to display as the input stream.

7. Use the following sample to test different list operations.

   private static void displayTextInputStream(InputStream input) throws IOException {
       BufferedReader reader = new BufferedReader(new InputStreamReader(input));
           while (true) {
               String line = reader.readLine();
               if (line == null) break;
               
               System.out.println("    " + line);
           } 
           System.out.println();
       }
   }