Sr. Data Engineer

Location San Francisco, USA
Discipline: Information Technology
Job type: Permanent
Salary: $170000 to $200000
Contact email: yvasquez@brightmetro.com
Job ref: 889453
Published: 27 days ago
About the Company:
 
Our client is a software company whose product is used by 40% of the Fortune 500 companies.

About the role:
Base Salary: $170k -200k
Location: 100% remote

Position Summary 
  
We're looking for a talented Senior Data Engineer who will have opportunities to work closely with customers to solve real technology challenges. The company is  rapidly expanding and you will be responsible for delivering new solutions and services while constantly improving our approach to architecture, scale, availability and fault-tolerance. 
  
Responsibilities:
  
  • Implement and support systems that reliably and efficiently provide interactive query performance on large amounts of multi-modal data.
  • Collect, parse, analyze, and visualize large sets of data.
  • Improve systems that handle scale.Identify opportunities and advocate for better performance of software, systems, and processes across teams.
  • Troubleshoot and improve the infrastructure required for optimal extraction, transformation, and loading of data from a variety of data sources using SQL and AWS ‘big data’ technologies.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product.
  • Design, develop, and lead the resolution of complex problems across teams.
  • Encourage and promote ideas/opinions of others from diverse backgrounds and experiences
You bring:
  
  • 5+ years of experience with large-scale data and query optimization techniques.
  • Experience with ETL to data warehouse systems.
  • Experience with AWS cloud services: Redshift, GCP BigQuery, EC2, RDS, Aurora Postgres.
  • Proficient in SQL.Understanding of NoSQL and RDBMS.Expertise in multiple scripting languages; ideally Python and Ruby.
  • Knowledge of cloud, distributed systems, and stream-processing systems.Innate curiosity, and a desire to learn and teach.
  • Empathy for your customers and colleagues.Eagerness to share your own ideas, and openness to those of others.
You might have:
Experience with Kubernetes, Docker, Helm.Experience with AWS.Experience with ML, AI.Experience working for a startup and/or SaaS organization.Open-source contributions and history of side-project.