GSPANN Technologies Looking for Azure Data Engineer(10 + Years Exp) at Fremont, CA Full Time

About GSPANN

We work in an exploding market of retail and e-commerce. We have served as a trusted business partner for some of the world’s most respected brands. We’ve worked with more than 200 organizations and have served as a trusted business partner for some of the world’s most respected brands. Our solutions have the businesses create custom-designed technology platforms, which have transformed the way our clients connect with their employees, partners, and customers. GSPANN is headquartered in Milpitas, CA with satellite offices around the world.

To know more about GSPANN, visit our website www.gspann.com Or connect on social media platforms: LinkedIn, Twitter and Facebook.

Azure Data Engineer
Location-Fremont, CA/ Remote
Job Type-Long Term

10 + years Experience required.
Primary Responsibilities: 

• Responsible for optimizing Spark jobs – needs to have strong Big Data and Spark Optimization knowledge
• Help build high performance and flexible streaming pipelines that can rapidly evolve to handle new technologies, techniques, and modeling approaches
• Build data expertise and own data ingestion pipelines 
• Write complex ETL processes and framework using Azure Data Factory ADF
• Implement large-scale near real-time streaming data processing pipelines
• Thorough knowledge of Spring frameworks Experience with Kafka messaging platform Experience with Big Data/streaming platforms such as Spark, Flink, Kafka Streams, and/or EventHb Experience using Azure Cloud (Azure vm, Azure cognitive search, HDI, Azure functions, ADLS, etc.)
• Familiarity with containers, micro-services and APIs Experience working with different operating systems (Unix, Windows, Linux)
• Identify and assist in implementation of automation for the validation and approval of design specifications. 
• Work with infrastructure engineers to ensure smooth deployments and sustainable performance for the platform Skill. 
• Deep understanding of web services and RESTful interfaces Experience with Git and continuous integration tools