MilwaukeeRecruiter
the smart solution for Milwaukee jobs

Big Data Architect (Spark Streaming)

Company: Advance Technologies llc
Location: Milwaukee
Posted on: February 14, 2019

Job Description:

Position : Big Data Architect (Spark Streaming) Location: Milwaukee, WI Contract Duration : 6+ Months Interview process: Webex Visa: USC, GC, GC-EAD, H1B, H4-EAD, TN Qualifications 12+ years of total IT experience including 3+ years of Big Data experience (Amazon EMR, Amazon Kinesis, Java, Spark Streaming, Spark SQL, HBase, Hive and Sqoop Hands on experience on Big Data tools and technologies is mandatory. Experience in building real time data streaming pipelines from Amazon Kinesis to Hive using Spark streaming on Amazon EMR At least one-year experience in design and executing Hadoop solutions on Amazon EMR. Knowledge on Amazon services including S3, EC2, Kinesis, Firehose and Cloud watch. Proven experience of driving technology and architectural execution for enterprise grade solutions based on Big Data platforms. Designed at least one Hadoop Data Lake end to end using the above Big Data Technologies. Experience in designing Hive and HBase Data models for storage and high-performance queries. Knowledge of standard methodologies, concepts, best practices, and procedures within Amazon EMR Big Data environment. Proficient in Linux/Unix scripting. Bachelor''s degree in Engineering - Computer Science, or Information Technology. Master''s degree in Finance, Computer Science, or Information Technology a plus. Experience in Agile methodology is a must. Experience in Storm and NoSQL Databases (e.g. Cassandra) is desirable. Good communication skills and problem-solving techniques Job Description Define big data solutions that leverage value to the customer; understand customer use cases and workflows and translate them into engineering deliverables Architecting and Designing Hadoop solution. Actively participate in Scrum calls, work closely with product owner and scrum master for the sprint planning, estimates and story points. Break the user stories into actionable technical stories, dependencies and plan the execution into sprints. Designing batch and real time load jobs from a broad variety of data sources into Hadoop. And design ETL jobs to read data from Hadoop and pass to variety of consumers / destinations. Perform analysis of vast data stores and uncover insights. Responsible for maintaining security and data privacy, creating scalable and high-performance web services for data tracking. Propose best practices / standards and implement them in the deliverables. Analyze the long running queries and jobs, performance tune them by using query optimization techniques and Spark code optimization.

Keywords: Advance Technologies llc, Milwaukee , Big Data Architect (Spark Streaming), IT / Software / Systems , Milwaukee, Wisconsin

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other IT / Software / Systems Jobs


Web Developer (Junior) - Sheboygan
Description: Employer is the fastest growing employer of emerging technology talent in the US and we are currently looking to hire over 100 new Software Engineers.Our Software Engineers design, analyze and build next-gen (more...)
Company: Revature
Location: Sheboygan
Posted on: 02/23/2019

Frontend Developer - Web / Mobile
Description: We are seeking a Senior Front-End Developer to develop the clientrsquos e-commerce applications at its Corporate Headquarters near Milwaukee, WI. Required Skills bull 3 yearrsquos software development (more...)
Company: Evolution Services, Inc.
Location: Kenosha
Posted on: 02/23/2019

Current College Students - SAP Concur iXp Intern - Mobile Android Developer Job
Description: COMPANY DESCRIPTION br br SAP started in 1972 as a team of five colleagues with a desire to do something new. Together, they changed enterprise software and reinvented how business was done. Today, (more...)
Company: SAP
Location: Kenosha
Posted on: 02/23/2019


Current College Students - 2019 Technology Spring Co-op (College Hire, January Start)
Description: Caring for the world, one person at a time has inspired and united the people of Johnson Johnson for over 130 years. We embrace research and science -- bringing innovative ideas, products and services (more...)
Company: Johnson & Johnson
Location: Racine
Posted on: 02/23/2019

Software Engineer (PostgreSQL)
Description: Job Req 19-01180 Job Description Software Engineer IV Location Austin, TX or Portland, OR Position Type FTPerm Placement Our client in automotive services are looking for a tenured Software Engineer to (more...)
Company: Ascent Services Group
Location: Hoffman Estates
Posted on: 02/23/2019

Current College Students - 2019 Technology Fall Co-op (College Hire, June Start)
Description: Caring for the world, one person at a time has inspired and united the people of Johnson Johnson for over 130 years. We embrace research and science -- bringing innovative ideas, products and services (more...)
Company: Johnson & Johnson
Location: Racine
Posted on: 02/23/2019

Field Service
Description: Field Service Technician Responsibilities
Company: Direct Recruiters, Inc.
Location: Racine
Posted on: 02/23/2019

Entry Level Software Engineer - Racine
Description: Revature is the fastest growing employer of emerging technology talent in the US and we are currently looking to hire over 100 new Software Engineers. Our Software Engineers design, analyze and build (more...)
Company: Revature
Location: Racine
Posted on: 02/23/2019

Junior Software Engineer - Waukesha
Description: Employer is the fastest growing employer of emerging technology talent in the US and we are currently looking to hire over 100 new Software Engineers.Our Software Engineers design, analyze and build next-gen (more...)
Company: Revature
Location: Waukesha
Posted on: 02/23/2019

Senior BI Developer
Description: POSITION RESPONSIBILITIES ul li Design and develop enterprise and departmental business intelligence, data warehousing and reporting solutions. li Work with
Company: Evolution Services, Inc.
Location: Kenosha
Posted on: 02/23/2019

Log In or Create An Account

Get the latest Wisconsin jobs by following @recnetWI on Twitter!

Milwaukee RSS job feeds