Principal Engineer – Data Pipeline – US Remote United States

Other Jobs To Apply

No other job posts for this day.

About The Role: Principal Engineer - Data Pipeline - US Remote We are seeking a highly skilled and innovative Principal Engineer to join our dynamic Data Pipeline team. The successful candidate will play a crucial role in developing and maintaining the infrastructure to collect telemetry at scale by building highly performant real-time data pipelines. Aviatrix unique position in enterprise cloud environments presents a unique set of technical challenges for the collection, transformation, and transmission of data across a varied architectural landscape. The team's products enable the development of data driven products in the Aviatrix suite of networking and security features enabling our end-to-end multi-cloud solution. What You’ll Do • Architecture/Design: You will be responsible for designing and architecting the data pipeline infrastructure needed for network analytics including data collection, storage, and processing components to ensure scalability, reliability, and performance of the pipeline. • Collection Data: You will lead and coordinate with other engineers to identify and collect relevant data from network devices, such as routers, switches, and firewalls. • Data Processing: You will lead and develop algorithms, processes to transform and cleanse the raw network data. This may involve parsing, normalizing, aggregating, and enriching the data to make it suitable for analysis. • Integration with Analytics Tools: You will have expertise in integrating the data pipeline with various analytics tools and platforms such as data visualization tools and ML • Performance Optimization: You will be responsible for optimizing the data pipeline to handle large volumes of network data efficiently, minimizing latency and maximizing throughput. This may involve parallel processing, distributed computing and leveraging cloud • Quality Control – you will be responsible for implementing data quality checks and validation mechanisms to ensure the accuracy, consistency and completeness of the network data flowing through the pipeline. • Monitoring and Maintenance – you will lead in setting up monitoring tools and techniques to monitor the health and performance of the data pipeline. • Collaboration and Leadership – as a data pipeline engineer, you will work closely with cross–functional teams. Requirements: • 10+ years of software development in building large-scale Data Analytics solutions. • Proficiency in Golang (preferred) or Python • Proficiency with common telemetry frameworks (Prometheus, Open Telemetry) • Proficiency with big data pipeline technologies (g., Logstash, FluentD, Kafka, Spark, Hadoop, Storm, Spark, Flink) • Domain knowledge in networking: (OSI stack, BGP, IP, TCP, UDP, HTTP, DNS; Linux network stack, SDN, network automation) • Experience with ML libraries (Scikit-learn, Pytorch, Tensorflow or Keras) is nice to have • Experience with Cloud Platforms a plus • BS in Computer Science, Software Engineering, Machine Learning, Mathematics, Statistics, or equivalent Preferred Qualifications • Past delivery of large-scale Data Analytics solutions for complex networking problems or environments • You have prior experience working on distribution systems • You have experience with production operations and good practices for putting quality • Code in production and troubleshoot issues when they arise • Take initiative and be responsible for delivering complex software by working effectively with the team and other stakeholders • You feel at home communicating technical ideas verbally and in writing (technical proposals, design specs, architecture diagrams and presentations) US Pay Range? The US National Annual base salary range for this full-time position is $210,000 - $250,000 + benefits + 401(k) match + equity. The pay range is determined by the role, work location, job-related skills, level, experience, and relevant education. Certain roles are eligible to earn sales commission, depending on the terms of the applicable plan. The range displayed is the minimum and maximum bolthires base salary and is applicable only for new hires for the listed position located in the US. Your Talent Advisor can share more details regarding salary ranges, benefits, and equity for your location during the hiring process.? #LI-LD1 #LI-REMOTE BENEFITS US: We cover 100% of employee premiums and 88% of dependent(s) premiums for medical, dental and vision coverage, 401(k) match, short and long-term disability, life/AD&D insurance, $1,000/year education reimbursement, and a flexible vacation policy. Outside the US: We offer a comprehensive benefits package which, (subect to regional variations) could include pension, private medical for you and dependents, generous holiday allowance, life assurance, long-term disability, annual wellbeing stipend Your total compensation package will be based on job-related knowledge, education, certifications and location, per our aligned ranges. About Aviatrix Aviatrix is the cloud networking expert. We’re on a mission to make cloud networking simple so companies stay agile. Trusted by more than 500 of the world’s leading enterprises, our cloud networking platform creates the visibility, security, and control needed to adapt with ease and move ahead at speed. Combined with the Aviatrix Certified Engineer (ACE) Program, the industry's leading multicloud networking and security certification, Aviatrix empowers the cloud networking community to stay at the forefront of digital transformation. WE WANT TO INCLUDE YOU We embrace the fact that not everyone’s journey took the same route or started at the same place. If your experience doesn’t quite meet the requirements but the opportunity excites you and you believe you could be great, don’t let that hold you back from applying. Tell us what you CAN bring and what makes you special. Aviatrix is a community where everyone's career can grow and we want to help you achieve your goals and be “your best YOU,” however that looks. If you're seeking an opportunity where you can be excited to start work every morning with enthusiastic people, make a real difference and be part of something amazing then let’s talk. We want to get to know you and how we could grow together. Aviatrix, Inc. is an equal opportunity employer and does not make hiring decisions based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training. Apply tot his job Apply tot his job Apply tot his job Apply tot his job

Back to blog

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...