Posts

My AWS Journey: From Cloud Novice to Passionate Cloud Enthusiast

Image
  When I first started my career, I had no idea what AWS was. It was just another acronym in the sea of tech jargon. Little did I know that it would become the cornerstone of my professional journey, shaping not just my career but also my passion for technology. This is the story of how AWS became my companion, my teacher, and my inspiration.  

Scaling Live Streaming for 62.2 Crore Concurrent Viewers: The Tech Behind India vs Pakistan Match

Image
  Extensive Preparation and Audits: Planning starts months in advance . Service owners define breaking points for their systems (front end, CDN, load balancer, back end, databases). Partners undergo audits to ensure their infrastructure and mitigations are ready. Front-End Optimisation: Code freezes are implemented well in advance of the back-end systems, and continue to ship new features during the tournament. Feature flags are used extensively to quickly turn off features on specific platforms if issues arise (e.g., increased crash rates). Simulations using tools like Charles mimic potential API failures (5XX errors, latency, DNS failures) to ensure a smooth user experience. Graceful degradation is implemented to minimise customer impact. Prioritising core features (P0 - live stream) and ads. Non-critical features (P1, P2) can fail without displaying error messages to users. Exponential back-off strategies are implemented for API retries to prevent system o...

10 Step process to scaling ZERO to Millions Users In Application

Image
1️⃣ 𝗕𝗲𝗴𝗶𝗻 𝘄𝗶𝘁𝗵 𝗮 𝘀𝗶𝗻𝗴𝗹𝗲-𝘀𝗲𝗿𝘃𝗲𝗿 𝘀𝗲𝘁𝘂𝗽: This is your starting point where a single server handles all(user+Dns+server) functionality. [EC2+RDS] 2️⃣ 𝗜𝗻𝘁𝗿𝗼𝗱𝘂𝗰𝗲 𝗺𝘂𝗹𝘁𝗶𝗽𝗹𝗲 𝘄𝗲𝗯 𝘀𝗲𝗿𝘃𝗲𝗿𝘀 (𝘄𝗲𝗯 𝘁𝗶𝗲𝗿): As traffic increases, a single server becomes insufficient. Add more web servers to handle user traffic.[EC2 Auto Scaling Group] 3️⃣ 𝗔𝗱𝗱 𝗮 𝗹𝗼𝗮𝗱 𝗯𝗮𝗹𝗮𝗻𝗰𝗲𝗿: A load balancer distributes traffic evenly among the web servers, preventing overload and ensuring availability. [Elastic Load Balancer] 4️⃣𝗜𝗺𝗽𝗹𝗲𝗺𝗲𝗻𝘁 𝗱𝗮𝘁𝗮𝗯𝗮𝘀𝗲 𝗿𝗲𝗽𝗹𝗶𝗰𝗮𝘁𝗶𝗼𝗻: Use a master database for writes and slave databases for reads to improve performance and availability.[RDS read replicas / DynamoDB] 5️⃣ 𝗜𝗻𝘁𝗿𝗼𝗱𝘂𝗰𝗲 𝗮 𝗰𝗮𝗰𝗵𝗲 𝘁𝗶𝗲𝗿: Caching frequently accessed data in memory improves system performance and reduces the load on the database. [ Elasticache / DAX] 6️⃣𝗨𝘁𝗶𝗹𝗶𝘀𝗲 𝗮 𝗖𝗼𝗻𝘁𝗲𝗻𝘁 𝗗𝗲𝗹𝗶𝘃𝗲𝗿𝘆 𝗡𝗲𝘁𝘄𝗼𝗿𝗸 (...

GOKARNA BEACH TREK: COMPLETE GUIDE

Image
  Gokarna, located in northern Karnataka, is a true beach paradise. With five major beaches boasting clean water, gentle waves, and stunning views, Gokarna is a must-visit destination for beach lovers. The Gokarna Beach Trek offers a unique way to experience the beauty of these beaches while hiking through the lush green hills that separate them. YouTube video What is the Gokarna Beach Trek? The Gokarna Beach Trek is approximately a 10 km long trek that takes you through the five main beaches: Gokarna Main Beach, Kudle Beach, Om Beach, Half Moon Beach and Paradise Beach. It can easily be completed in 5-6 hours, although the time may vary depending on how long you spend at each beach and on breaks. Why should you do this trek? The BEST way to explore Gokarna : Hiking along the coast offers breathtaking views and allows you to experience the true beauty of Gokarna. Accessibility : Half Moon Beach and Paradise Beach are only accessible by hike or ferry. Cost-effective : Hiking ...

Journey to Everest Base Camp: A Tale of Adventure and Suspense

Image
for more detail EBC itinerary like what to pack and carry and our details experience  Click here My journey began in Bengaluru, where I boarded a train that would take 28 long hours to reach Pune. The next day, I met up with my fellow traveler, and we were excited for our next leg: a train to Gorakhpur. However, we soon discovered we had RAC tickets, meaning we had to share a seat for the entire 33-hour journey. I was okay with it, but my partner wasn’t thrilled. Yet, we managed to settle in. The train passed through Bhopal, Banaras, and Mirzapur, but then it was delayed by four hours. To save time, we decided to take a direct bus to the Sanoli border, which would take about three to four hours. Once we arrived, a friendly tanga rikshaw driver took us to a money exchange shop, where we got a good rate of 1.6 NPR. After purchasing Nepali SIM cards, we hopped on a bus to Kathmandu. The driver promised we’d arrive by 6 PM, but the bumpy roads delayed us, and we reached around 11 PM in...

Discovering Delhi: A Winter Adventure

Image
Delhi, the vibrant capital of India, is known for its extreme weather. Whether it's the scorching heat of summer or the biting chill of winter, Delhi never does things halfway. My visit happened in the winter, a season where the city's cold can be quite severe. Despite this, I was excited to explore the rich history and culture that Delhi has to offer. Arrival and First Impressions My journey began as my train pulled into Delhi Station. From there, I had to reach Dwarka, where my Couchsurfing host was waiting for me. I decided to take the metro, one of the largest and most efficient networks in the world. After an hour-long ride, I arrived at my destination. My host was incredibly kind, offering me delicious homemade food which provided a warm welcome to the city.  Exploring Old Delhi: Jama Masjid and Chandni Chowk The next day, I set out to explore Old Delhi. My first stop was the magnificent Jama Masjid, one of the largest mosques in India. The architectural beauty and the se...

Journey from Bengaluru to Mumbai via Mangalore, Udupi, Manipal, Gokarna, and Goa

Image
Bengaluru to Mangalore The journey began from Bengaluru at the KSRTC railway station at night. On the train, I met two people heading to the Amrutham Temple near Dharmasthala, a famous spot in Dakshina Kannada. Mangalore In Mangalore, Pavan hosted me at his house. I arrived at Mangalore Junction, took a bus to Lalbagh (KSRTC), and then another bus, number 33, to Akash Bhavan. Pavan's home is small but cozy, a 1RK setup, where he lives with his wife and daughter. He works in the pharma industry, but despite some financial setbacks, he seemed friendly and willing to help. Pavan is a heavy smoker, which was quite noticeable. After freshening up, we decided to explore the city. However, it started raining heavily, a common occurrence in Mangalore. With an umbrella and Pavan's raincoat, we managed to visit some places. I tried the neer dosa, which was delicious, visited Mangaladevi Temple, and took a boat from Sultan Battery to the beach. I enjoyed some fried fish and toddy, explore...

My Experience at AWS Summit Bengaluru 2024

Image
   Early Start and Arrival On the day of the AWS Summit Bengaluru 2024, I made my way to the Sheraton Hotel in Whitefield bright and early. As an early bird, I was fortunate to receive some exclusive swags upon registering. The event was off to a fantastic start with this pleasant surprise!  Breakfast and Networking After securing my ID, I headed to the breakfast area where a lavish buffet awaited. While enjoying the delicious spread, I had the opportunity to meet and chat with a fellow attendee from HCL. It was a great way to kick off the day, sharing our enthusiasm for the upcoming sessions and activities.  Keynote Session At 10:00 AM, the keynote session began, with a primary focus on Generative AI (GenAI) services. The speakers highlighted the transformative potential of GenAI and how AWS is leading innovation in this space. It was inspiring to hear about the advancements and the future direction of AWS services.  Exploring Sponsor Stalls Post-keynote, I exp...

Data Engeering in Poem

Image
whether you are Cloud engineer/Data Engineer/Data Analyst/Data Scientist/ETL Developer you all using this below stacks Are you ready for a poetic journey through the world of data? 📊✨ 🔧📊 I am a Data Engineer, bold and true, Crafting solutions in a digital brew. With stacks like AWS S3 and Glue, I sculpt the data landscape, fresh and new. 🌟 🔍💻 From Athena's queries to Redshift's might, I harness the power of data's light. Lambda functions dance with Kinesis' flow, In the symphony of insights, we grow. 🎶 💨🔄 Airflow orchestrates, with precision's grace, Scheduling tasks in a seamless embrace. SQL and Python, my trusted tools, Transforming raw data into analytical jewels. 💎 🔗 In the realm of version control, Git is my guide, Jira keeps projects on a steady stride. ETL, the heartbeat of my craft, Where data's journey begins and ends at last. ⏳ So here's to the Data Engineer's tale, In a world where information sets sail. With stacks in hand and ski...

Varanasi - A Journey of Spirituality and Serenity

Image
Benaras, Varanasi, Kashi, or Banaras - regardless of the name, this ancient city has the power to transform your perception of life and spirituality.  Mark Twain once said, "Benaras is older than history, older than tradition, older even than legend, and looks twice as old as all of them put together."  Varanasi, one of the world's oldest continually inhabited cities, is a melting pot of cultures, religions, and traditions, offering a glimpse into India's rich past and spiritual depth. The Journey from Bengaluru to Varanasi The 45-hour train journey from Bengaluru to Varanasi was a mix of excitement and anticipation. Varanasi, also known as the spiritual capital of India, is steeped in mythology and history, making it a must-visit destination for those seeking spiritual enlightenment and cultural immersion. The train journey itself is an experience, passing through diverse landscapes and offering a glimpse into the heart of India. Exploring the Spiritual Heart of Vara...