This is Rajesh
from KRG TECHNOLOGIES
I have an exciting new opportunity that I wanted to
share with you and your network.
For the below mentioned job
description. Kindly forward me your resume, rate and contact details for
further process.
Job title: Big Data
Expert
Location: Redmond, WA
Duration: Full-time
Location: Redmond, WA
Duration: Full-time
Development :
1.
Build the Event Hubs integration with
Service Fabric micro services implementation. Streaming the processed files
from blobs into EH for downstream processing.
1.
Anonymized files (~1000 of them and to a
size of ~GB) will be given as input
2.
Service Fabric code portion will be
provided.
2.
Build the Spark processing reading off
EventHubs, implementation in either Python or Scala would suffice.
1.
Look at the caching needs; leverage .cache
to retain appropriate results from Spark ‘Actions’ in Spark executors
3.
Our team will evaluate a set of data store
that would be a landing spot post Spark – Blobs being a required one. We will
pick 1 or 2 from this list -- SQL DW, Azure SQL DB, Cassandra and DocumentDB
being other candidate stores and we will have code snippets and/or guidance
Integration & Deployment :
1.
Integrate the items from above with
completed items (Azure Data Factory with ARM provisioning, picking up from the
ADF pipeline which lands files onto blobs)
2.
Apply best practices for capacity
planning, deployment for E2E
3.
Integrate the deployment with existing set
of tools and processes.
Testing :
1.
Build a unit test framework that can test
each building block in isolation (ADF Blobs, Blobs
Service Fabric, Service Fabric EH, EH Spark, Spark
<Data Store>
2.
Build an E2E test environment with
telemetry on latency, throughout with percentiles. *Leverage APM tools as
appropriate
Please send your updated resume with contact details to rajeshkrgtech12345@gmail.com
If you are interested for this position then don't forget to shoot a mail.
Then we can move on for further process....
Then we can move on for further process....
Thanks for your time.
Kind Regards,
Rajesh (Раджеш)
Technical Recruiter
KRG Technologies Inc
Phone: 661 367 8000 Ext - 514
0 comments:
Post a Comment