1) Install aws. Make sure aws >= 1.16; After installing make sure that aws is in the path pip3 install awscli –upgrade –user 2) Get the devops user credentials Make sure you have set up login (ie added the user in system:masters group in aws-auth configmap). This the one of the first thing we will […]
Tag: aws
When you are stuck with a migration problem in elasticsearch, say version currently run is 2.x and have to migrate to say 6.x. You have to do this: Migrate 2.x to 5.x Migrate 5.x to 6.x This is a cumbersome process, also time consuming. You need a temporary elasticsearch cluster, running in version 5. Not […]
If a file is in s3 and gunzipped, we can easily stream it and read line by line in python. Boto has problem. The read method redownloads the key if you call it after the key has been completely read once (compare the read and next methods to see the difference). So i have used […]