http://www.missiondata.com/blog/systems-integration/29/streaming-data-to-s3-with-ruby/ Louisville-based Web Development & Software Engineering Tue, 02 Mar 2010 02:10:53 -0500 http://wordpress.org/?v=2.8.4 hourly 1 http://www.missiondata.com/blog/systems-integration/29/streaming-data-to-s3-with-ruby/comment-page-1/#comment-10292 Markus Thu, 25 Jan 2007 03:33:25 +0000 http://blogs.missiondata.com/?p=29#comment-10292 Thanks a lot for your snippet. It works fine, at least for text files. But when I try uploading pdf or zip-files, it will only upload half of the file (size is incorrect and I can see only the first "half of the cryptic symbols). I guess the problem is related with the content type. I tried binary/octet-stream and application/octet-stream, but both didnt work. Do you have any idea why it does not work for me? Thanks, Markus Thanks a lot for your snippet. It works fine, at least for text files.
But when I try uploading pdf or zip-files, it will only upload half of the file (size is incorrect and I can see only the first “half of the cryptic symbols). I guess the problem is related with the content type. I tried binary/octet-stream and application/octet-stream, but both didnt work.
Do you have any idea why it does not work for me?
Thanks, Markus

]]> http://www.missiondata.com/blog/systems-integration/29/streaming-data-to-s3-with-ruby/comment-page-1/#comment-2178 Mission Data Blog » Blog Archive » S3 Streaming With PHP Sat, 25 Nov 2006 18:45:32 +0000 http://blogs.missiondata.com/?p=29#comment-2178 [...] Steven pointed out that someone was looking for a way to stream to S3 using PHP and said I should figure out how to get it going. Since he made a patch to let you stream data with Ruby using S3 I figured I should do one for PHP. There may be better ways of doing this but since I’ve already done it with C using curl I figured that would be the fastest way. [...] [...] Steven pointed out that someone was looking for a way to stream to S3 using PHP and said I should figure out how to get it going. Since he made a patch to let you stream data with Ruby using S3 I figured I should do one for PHP. There may be better ways of doing this but since I’ve already done it with C using curl I figured that would be the fastest way. [...]

]]> http://www.missiondata.com/blog/systems-integration/29/streaming-data-to-s3-with-ruby/comment-page-1/#comment-1702 Paul Jones Thu, 09 Nov 2006 21:56:21 +0000 http://blogs.missiondata.com/?p=29#comment-1702 Excellent! We use S3 as part of our backup plan and some of the files we transer out can get big. This is just what I was needing. Excellent! We use S3 as part of our backup plan and some of the files we transer out can get big. This is just what I was needing.

]]> http://www.missiondata.com/blog/systems-integration/29/streaming-data-to-s3-with-ruby/comment-page-1/#comment-1701 oOcha » Blog Archive » Backup plan Thu, 09 Nov 2006 21:53:21 +0000 http://blogs.missiondata.com/?p=29#comment-1701 [...] I also used some information from a great post on the Mission Data Blog. The current code I had opened a file read it into memory and then transferred that to S3. The mentioned blog post explained how to change Net::HTTP to stream a file. [...] [...] I also used some information from a great post on the Mission Data Blog. The current code I had opened a file read it into memory and then transferred that to S3. The mentioned blog post explained how to change Net::HTTP to stream a file. [...]

]]> http://www.missiondata.com/blog/systems-integration/29/streaming-data-to-s3-with-ruby/comment-page-1/#comment-1679 giles bowkett Wed, 08 Nov 2006 22:24:57 +0000 http://blogs.missiondata.com/?p=29#comment-1679 Hi, I saw your post on the Amazon boards for S3, thanks a ton for blogging this, I thought it was going to be much harder. The only real change I had to make was your code was to give it a binary/octet-stream Content-Type (because I was streaming up media files rather than text). Awesome work. Hi, I saw your post on the Amazon boards for S3, thanks a ton for blogging this, I thought it was going to be much harder. The only real change I had to make was your code was to give it a binary/octet-stream Content-Type (because I was streaming up media files rather than text). Awesome work.

]]> http://www.missiondata.com/blog/systems-integration/29/streaming-data-to-s3-with-ruby/comment-page-1/#comment-179 Jim Moy Fri, 16 Jun 2006 22:48:11 +0000 http://blogs.missiondata.com/?p=29#comment-179 Probably want to qualify this -- you need a pretty recent ruby, 1.8.4, to take advantage of body_stream in Net::HTTPRequest. Probably want to qualify this — you need a pretty recent ruby, 1.8.4, to take advantage of body_stream in Net::HTTPRequest.

]]>