PySpark Expert
$25-50 USD / hora
We are looking for a PySpark Expert to help optimise our PySpark pipeline. We are using Kafka for ingestion, PySpark for Stream processing and Elasticsearch for storage. Our pipeline has a couple of bottlenecks, which we want to unclog.
We want someone who understands how to use the various optimisation techniques in Spark, knows how to set the configurations for hardware resources and understands YARN.
If you are an expert in this space, please reach out to us.
Nº del proyecto: #18170398
Sobre el proyecto
6 freelancers están ofertando un promedio de $37 / hora por este trabajo
Hi. I have been working on pyspark since 5 months, In one of my project i had to made pipeline which get data from mysql and perform some parallel operation and submit back to the mysql, the purpose of doing that to Más
https://www.freelancer.com/projects/software-architecture/Elastic-search-kibana-cuckoo-API https://www.freelancer.com/projects/javascript/Webdevelopment-Project-for-Shadab/ https://www.freelancer.com/projects/softwar Más