When you are stuck with a migration problem in elasticsearch, say version currently run is 2.x and have to migrate to say 6.x. You have to do this: Migrate 2.x to 5.x Migrate 5.x to 6.x This is a cumbersome process, also time consuming. You need a temporary elasticsearch cluster, running in version 5. Not […]
Tag: s3
If a file is in s3 and gunzipped, we can easily stream it and read line by line in python. Boto has problem. The read method redownloads the key if you call it after the key has been completely read once (compare the read and next methods to see the difference). So i have used […]