5 Critical Mistakes Every Data Engineer Must Avoid for Career Success
Insider Secrets to Thriving as a Data Engineer
Are you looking to supercharge your career and avoid costly mistakes along the way? You've come to the right place.
As a seasoned data engineering leader, I've seen it all—the good, the bad, and the ugly. I'm here to share with you the five most common pitfalls that can derail your career growth and, more importantly, how to avoid them.
So whether you're just starting out or a seasoned pro, this article is your roadmap to success. We'll cover everything from taking control of your career path to building a robust network to the most important lesson of all - prioritising your health and family above all else.
The last tip is the one you want to take advantage of. It's a lesson I learned the hard way, and I want to help you avoid the same regrets.
Reading time: 11 minutes
📣 Do you want to advertise in Data Gibberish? Book here
🛤️ Mistake #1: Waiting for Your Manager to Steer Your Career
Most engineers I've led over the years made the mistake of waiting for me to hand them the perfect career plan. They expected me to tell them exactly what to learn, what projects to take on, and what levels to aim for. And while reactivity can work, it fails to account for one crucial thing - you.
Your career path must be tailored to what makes you happy and fulfilled. You are unique, and your career should be, too.
Waiting for someone else to dictate your journey is a recipe for dissatisfaction and regret.
Instead, I urge you to take control of your own career planning and progression. Create a plan that aligns with your aspirations, even if it changes over time. Drive your own growth and development. Walk a path that excites you to get out of bed each day.
Remember, you can make plans for your career, or someone else will make them for you. You don't want to wake up one day and realise you've been chasing someone else's dream.
Creating your own career plan can feel overwhelming. But it's okay for your plan to evolve as you grow and your interests change. The key is to start somewhere and keep iterating.
Reflect on what truly matters to you. What are your strengths and weaknesses? What kind of work energises you? What impact do you want to have? Use those insights to craft a vision for your ideal career, then break it down into concrete steps. Before you know it, you'll be forging your own path.
A quick reminder: I am running the first Ask Me Anything session at the end of the week. You have a couple of more days to participate before the form closes.
💰 Mistake #2: Not Negotiating Salaries Proactively
Let's talk about money. More specifically, let's talk about ensuring you're paid what you're worth.
You must negotiate salary both when you are hired and throughout your tenure at a company. But many people make the mistake of waiting until their formal review to discuss salary. Here's the issue with waiting until the last moment: By the time official reviews happen, it's often too late.
Most companies have an annual salary review process at the beginning of the year. But many people don't realise that budget discussions typically start at least 3 months prior. So, suppose you wait until your official review to bring up the salary. In that case, chances are the budget has already been set with little room for negotiation.
Instead, I suggest starting salary conversations with your manager well before official reviews. Start them today. Make sure you are included in budget planning discussions. Prepare to make a strong case for your value and contributions.
I learned this lesson the hard way. Early in my career, I mistakenly waited and missed out on raises for 2 years. I thought my salary would take care of itself if I just worked hard. But when I finally asked, they increased my salary off-cycle. It was a harsh wake-up call.
You trade your valuable time and skills for money—make sure it is a fair trade.
Be proactive in these discussions and advocate for your worth.
I know talking about money can be uncomfortable. But think of it this way - you wouldn't hesitate to negotiate the price of a car or a house. Your salary should be no different.
Treat your employment as a business transaction. You provide a service (your skills and expertise) in exchange for compensation. Ensure that exchange is equitable.
And if negotiating makes you anxious, remember - the worst they can say is no. But you'll never know what could have been if you don't ask.
So, do your research, know your market value, and practice your pitch. And most importantly, believe in yourself and the value you bring. With preparation and confidence, you'll secure the salary you deserve.
🧰 Mistake #3: Focusing Too Much on Specific Tech Over Concepts
I've seen too many data engineers become experts in one specific technology and then refuse to work with others. They know every nuance of their chosen tool, but ask them to switch gears, and they're lost.
Here's the problem - focusing too narrowly on specific tools severely limits your career growth. The data engineering landscape constantly evolves, with new technologies emerging all the time. You'll quickly become irrelevant if you're only comfortable with one tool.
Instead, I recommend learning underlying concepts you can apply across tools and platforms. Develop deep knowledge in one area and broad knowledge across many.
For example, rather than just mastering Snowflake, learn data warehousing fundamentals. This way, you can easily pick up Snowflake, Databricks, BigQuery or whatever else you encounter. The specific tool may change, but the core principles remain constant.
Being adaptable and quickly learning new technologies is crucial to advancing your career. It shows that you're versatile and valuable to any team.
Now, having deep expertise in one area can certainly be beneficial. But don't let expertise come at the expense of broader knowledge.
And while technical skills are essential, pay attention to your soft skills. As you progress in your career, things like communication, leadership, and problem-solving become increasingly critical. Technical prowess alone will only take you so far.
So embrace continuous learning. Stay curious, experiment with new tools, and push yourself outside your comfort zone. The most successful data engineers adapt and thrive in an ever-changing landscape.
🤝 Mistake #4: Not Building a Strong Professional Network
Your professional network is one of your greatest assets throughout your career. It can open doors to new opportunities, provide guidance and mentorship, and serve as a reference. You never know where your next opportunity will come from.
But many data engineers fail to invest enough time and effort into building their network. They get so focused on the technical aspects of their job that they neglect the human connections that can make all the difference.
Instead, I recommend making networking a priority both online and in-person. Attend conferences and events to meet people. Post regularly on LinkedIn, sharing what you learn and engaging with others' content. Comment on posts by people you admire and want to connect with. Reach out to me!
I can personally attest to the power of networking. It helped me land my first job and my current role, which I've been in for 7 years. I mean, I've been co-organising a free conference for 11 years to give back to the community. Even COVID couldn't stop us, though we had to go virtual.
I know networking can feel daunting, especially for introverts. But remember, everyone is there for the same reason - to connect and learn from each other. You don't have to be the centre of attention. Just be genuine and interested in others.
Start small. Set a goal to attend one event or reach out to one new person each month. Over time, those small interactions will compound into a robust network.
And when you do make those connections, don't just let them fade away. Follow up, stay in touch, and seek ways to provide value. The strongest networks are built on mutual benefit and genuine relationships.
One more thing - when leaving a job, don't burn bridges. You never know when you'll cross paths with someone again. The data engineering world can be surprisingly small, and your reputation will follow you.
So get out there and start building those connections. Investing in your network will pay dividends throughout your career. Your next big break might come from a casual conversation at a meetup or a LinkedIn message from an old colleague.
❤️ Mistake #5: Prioritising Work at the Expense of Health and Family
I've saved the most important mistake for last. Prioritising work over life and family is the biggest mistake and regret of my life.
I come from a poor background and wanted to build a better life for my family. So, I threw myself into my work. I went to the office early and came home late, even on weekends. I thought if I worked hard enough, I could give my family everything they needed.
But while this work ethic advanced my career, it came at a devastating personal cost. I experienced multiple burnouts and health issues over the years. More importantly, it damaged my marriage and caused me to be absent from my kids' lives.
I deeply regret prioritising work over family and implore you to avoid making the same mistake. Everything I achieved came at the expense of what truly matters.
Instead, I urge you to set clear boundaries between work and the rest of your life. Make time for hobbies, exercise, relaxation and loved ones. Protect your physical and mental health. Ruthlessly prioritise your family and personal life.
I know it can be challenging. Our society glorifies overwork and constant hustle. But trust me, no amount of career success is worth sacrificing your health and relationships.
Looking back on your life and career, you're more likely to regret neglecting your family than working less. You can always find another job, but you can't get back lost time with loved ones.
I'm not saying you shouldn't work hard. Sometimes, you need to put in extra hours to meet a deadline or finish a project. But that should be the exception, not the norm.
Set boundaries and stick to them. Turn off notifications after hours. Take your holiday. Be fully present when you're with family and friends.
And if you find yourself in a job that consistently demands more than you're willing to give, it might be time to reevaluate. No job is worth your health and happiness.
I wish someone had given me this advice when I started out. But I'm sharing it with you now, hoping you can learn from my mistakes.
Remember, your career is essential, but it's not everything. Nurture the relationships and activities that bring you joy outside of work. Those are the things that will sustain you in the long run.
Summary
We've covered a lot today, so let's recap. The five most common mistakes I've seen data engineers make in their careers are:z
Waiting for managers to steer their career course
Not proactively negotiating salaries
Focusing on tech over concepts
Neglecting to build a strong network
Prioritising work at the expense of health and family
You can accelerate your growth by being aware of these pitfalls and taking the opposite approach. Take control of your own career path and goals. Develop deep and broad skills. Advocate for your value through salary negotiations. Cultivate a robust professional network. And most importantly, prioritise your health, family, and life outside of work.
Remember, your career is a marathon, not a sprint. Continuous learning, reflection and course correction will serve you well in the long run.
There will be ups and downs, successes and failures. But if you stay true to yourself, keep growing and enjoy the journey, I have no doubt you'll achieve great things.
Learn from the mistakes of those who came before you (myself included) and chart your own path. Embrace the challenges, celebrate the victories, and never stop learning.
What was the greatest mistake you’ve made throughout your career? Hit reply and message me directly. I’d love to chat about that with you.
Until next time,
Yordan
📚 Picks of the Week
Uber’s team need to tackle massive data challenges every day. Check this piece to learn how they handle the data for more than 10 billion trips a year. (link)
Okay, I know I post content from
often, but you don’t want to miss this one. Even more, you must read this if the business sees your data team as a cost centre. (link)And while we are still on the great teams topic, here is an article by
. Here, Alvaro discusses building high-performing (not only data) teams. (link)
Did you enjoy this article? Hit the ❤️ button or share it with a friend or coworker. 🙏🏻
Great notes, 100% applies to other engineering roles as well.