Redshifttrabajos
I am looking for job support on below technologies who has experience in all below. Requirement: Loading data from S3 to Redshift by applying data transformations according to business requirement. Very well knowledge on Fact and Dimensions. PySpark Scripting Infrastructure as a Code(IAC) AWS Service Catalog Cloud Formation S3 Lambda AWS Glue/Glue Job RedShift Dynamo DB AWS Transfer Family Python
...Glue, Lambda functions • Configure and use Dynamo DB to store, process and analyze NOSQL data • Design and optimize data models on AWS Cloud using AWS data stores such as Redshift, RDS, S3, Athena • Author ETL processes using Python, Pyspark • Build Redshift Spectrum direct transformations and data modeling using data in S3 • ETL process monitoring using Cloudwatch events • You will be working in collaboration with other teams. Good communication must. Qualifications & Experience. • Must have 4+ years of big data ETL experience using Python, S3, Lambda, Dynamo DB, Athena, Glue in AWS environment • Expertise in Redshift, Kinesis, EC2 clusters highly desired • Past or current experience working with US clients preferr...
Need to write Redshift UDF, to extract JSON data into Tables.
I am looking for people who can help on AWS/Python Developer job support. They should know below services/tools/languages to perform the job. Infrastructure as a Code(IAC) -- Creating a CFT Templates AWS Service Catalog Cloud Formation S3 Lambda AWS Glue RedShift Dynamo DB AWS Transfer Family Python
...Google Tag Manager, SendGrid, Google Sign-in, Facebook Login, Google Tag Manager, MoEngage, Google Drive, Segment, Google Admob, YAMM (yet another mail merge) Product & Design: Google Fonts, Sketch, Zeplin, Framer. Analytics & Data Science: CrazyEgg, Google Analytics, Bing Universal Event Tracking, Facebook Pixel, Crimson Hexagon, Yahoo! Analytics, Adjust, MoEngage, Sift Science, Segment, Amazon Redshift, Amazon s3, Apache Hive, Apache Kafka, Confluent, Datadog, Dataiku, Domo, Google BigQuery, Holistic Data Software, MemSQL, Optimizely, Periscope Data, Postgre SQL, Qubole, Tensorflow, adjust HR: SmartRecruiters Finance and Accounting: Sift Science, Google Wallet, Square Developer: AMP, Adobe Flash, Android Priority Jobqueue, Android Wear SDK, Apache Commons, Apache HttpCo...
I need help with spark, pandas, S3, JDBC, delta file, delta lake, Redshift, athena, list comprehension, lamda function and hashing algorithm.
Hello, We are looking for AWS cloud engineers for our company. Must haves:- - Strong knowledge of different AWS services including Lambda, API Gateway, S3, Glue, Redshift, etc. - Proficiency in Python - Knowledge of Pyspark - Knowledge of Big Data will be a plus Salary :- Decent Hike on your Current CTC Location :- Indore
Hi Expert, I am looking for some implementation on PySpark with AWS Services like Lambda, Glue, EMR, Redshift, Athena, Kinesis etc.
...Apache Cassandra) Amazon Kinesis Amazon Kinesis Analytics Amazon Kinesis Firehose Amazon Kinesis Video Streams Amazon Lex Amazon Lightsail Amazon MQ Amazon Machine Learning Amazon Macie Amazon Managed Blockchain Amazon Managed Streaming for Apache Kafka Amazon Mobile Analytics Amazon Neptune Amazon Personalize Amazon Pinpoint Amazon Polly Amazon Quantum Ledger Database Amazon QuickSight Amazon Redshift Amazon Rekognition Amazon Relational Database Service Amazon Route 53 Amazon S3 Glacier Deep Archive Amazon SageMaker Amazon Simple Email Service Amazon Simple Notification Service Amazon Simple Queue Service Amazon Simple Storage Service Amazon Simple Workflow Service Amazon SimpleDB Amazon Sumerian Amazon Textract Amazon Timestream Amazon Transcribe Amazon Translate Amazon Virtua...
...Time = 40h/week, for a minimum of 6 months with possibility of extension Responsibilities: - If you enjoy working in a fast-paced environment that cherishes pragmatism, yet delivers to enterprise software standards, then you're our ideal candidate for this role - Advanced knowledge of Gitlab, Postgres (SQLAlchemy), and the AWS platform is a strong plus for our candidate - Solid experience with Redshift, Timescale, Airflow, Snowflake or is a big plus Requirements: - Solid experience with Python (Flask) - Strong 6+ years in software development, primarily Python Python (Flask) and/or JavaScript - We need a candidate with an outstanding knowledge of Testing-expertise, SQL-Alchemy / Marshmallow, Postgres. * Fluent in advanced business English and a good, proactive communicat...
Senior Data Engineer Technical Skills Languages – Python, SQL, Java, HCL, HTML/CSS/Javascript, Bash Database Technology – Spark, SybaseIQ, DB/2, Snowflake, Redshift, Hive, Presto, Oracle PL/SQL Tools – AWS, Terraform, Kubernetes, Docker, Jupyter, Intellij, vim, Git, SVN, Apache, nginx, Splunk, SSH · Primarily should have worked on the Data Lake, a petabyte-scale Data Warehouse built for Goldman Sachs’ unique requirements. The lake is used across hundreds of teams for many time-sensitive critical applications. · Derived a variety of SLOs and health indicators for the lake. Successfully optimized the lake, bringing ingestion time down under 15 minutes for more than 90% of users. · Designed an event-driven ...
I need someone to create two files one with all admin queries with the example tested ... like create user, check user privileges, check group privileges etc all admin related in one single file with the list of queries.
We have a 3Ds Max scene that we need to convert to C4D with redshift materials. We are on a busy schedule and don't have to to do it ourselves, so we are looking for someone to do this. We are on a bit of a tight schedule so if you could do it today that would be great. This is the scene: Let me know if you can do it today and for what budget.
About: I require 8 x 20 second videos demonstrating robots moving shelves in a warehouse. The 8 clips are variations on camera angles and movement of the robots. Reference: Please see video references. This is pretty much an example of what I need. However, instead of bo...are variations on camera angles and movement of the robots. Reference: Please see video references. This is pretty much an example of what I need. However, instead of boxes, I need buckets and a different type of robot (see reference "box and robot "). I can supply the models. Skills: Looking for someone who is skilled in modelling and rendering, using something like Octane or Redshift. Deliverables: - 8 x 20 sec animations - 4K 30FPS ProRes .mov codec - 3D and After Effects Files (Cinema 4D pre...
Hi, we need to load data from Staging tables in redshift into Fact & dimension tables using AWS glue studio. There are 3 fact tables and we need to load data from 4-5 staging tables Work has to be done remotely using Anydesk
We are seeking experienced freelancers for Data Engineering Project with one of the enterprise client. If you are looking for an ongoing project to put yo...Support in building complex queries required by the product teams Handle data integration, consolidation and reconciliation activities for digital products Provide governance support to ensure the data is stored and managed as per industry practices Support data preparation activities for analytics including pipelining, data cleansing and web scrapping Requirements: Preferred stack: Postgresql, Redshift, Airflow, SQL, Python Strong experience in SQL and data architecture Strong experience in warehousing Have handled data engineering & management projects before Duration: 6 months Availability: 40 hours a week Time zone:...
LOOKING FOR EXPERIENCED AWS DVELOPER - AWS API GATEWAY / DOCKER / KUBERNETES / REDSHIFT /NODE MUST HAVE DEEP EXPERTISE IN AWS
we are looking for Real-time AWS consultant. need someone who has good hands on experience with AWS (Migrating data from cloudera to AWS, Autosys, s3, redshift, Hadoop knowledge). must have more than 5 years of real-time experience. need to work 2-3 hours/day from Monday to Friday online. should be flexible with timing.
we are looking for Real-time AWS consultant. need someone who has good hands on experience with AWS, Cloudera, Autosys, s3, redshift, Hadoop knowledge (Fulltime support Female). must have more than 5 years of real-time experience. need to work 2-3 hours/day from Monday to Friday online. should be flexible with timing.
we are looking for real-time AWS consultant. *need some one who has good hands on experience with AWS (AWS, Cloudera, autosys, s3, redshift, hadoop knowledge (Fulltime support Female)) *must have more than 5 years of real -time experience. *need to work 2-3 hrs per day from Monday to Friday through online. *should be flexible with timing.
we are looking for Real-time AWS consultant; need someone who has good hands on experience with AWS, Cloudera, autosys, s3, redshift, hadoop knowledge (Fulltime support Female). must have more than 5 years of real-time experience. need to work 7-8 hours/day from Monday to Friday online. should be flexible with timing.
I am looking for some help in developing a python test framework, that aids in testing data across multiple frameworks: 1) AWS - Redshift 2) AWS - S3 3) GCP - Big Query 4) GCP - data store Attached is the first piece of the package requirement. First, we will start with the connection methods for the databases listed in the document. I have provided detail in section a), b), c) as well Also tried to provide some pseudo code on how the package will be used. Please review the document and let me know things that are not clear.
I have a repository written in Python and Pyspark. It is failing due to some user permission issue. Need a quick fix.
...Big Data engineering in the Cloud (ideally GCP) Airflow or alternatives What Do We Expect: 3+ years of full-time, industry experience in software development Strong coding skills in Python (preferred) Advanced query language (SQL) knowledge Broad knowledge of different types of data storage engines (Relational, non-relational) Hands on experience with at least 2 of them – e.g. PostgreSQL, MySQL, Redshift, ElasticSearch Experience with orchestration tools (Airflow is the best fit) Experience with batch or real-time data processing Rigor in high code quality, automated testing, and other engineering best practices Cloud Knowledge – Google Cloud (best fit), AWS, Azure BS/MS in Computer Science or a related field (ideal) Benefits Great Team: The Data Intelligence Tribe c...
Hi All, Looking for expert in below skillset Design and support the new and evolving sources of data being brought into the data warehouse. Must Haves: At least 9 years’ experience. Need Senior level candidate who can spearhead AWS effort. Experience working with AWS Analytical Component - Redshift. Experience working with AWS GLUE - Managed ETL Service. Experience optimizing data retrieval processes supporting API output and reading API calls. Experience with performance tuning. Let me know if you have experience in it
data engineer with AWS platform Design and support the new and evolving sources of data being brought into the data warehouse. Must Haves: Need candidate who can spearhead AWS effort. Experience working with AWS Analytical Component - Redshift. Experience working with AWS GLUE - Managed ETL Service. Experience optimizing data retrieval processes supporting API output and reading API calls. Experience with performance tuning.
Need Python, AWS Data Engineer to give support for 2 hrs a day from Mon-Fri. We will give 20-24k per month. Preferred experience 5+ years . Req: Create etl pipeline workflow using aws cloud formation, this include...Data Engineer to give support for 2 hrs a day from Mon-Fri. We will give 20-24k per month. Preferred experience 5+ years . Req: Create etl pipeline workflow using aws cloud formation, this include creating crawlers, triggers, aws glue scripts for transformation and push to s3 buckets. Utilize Athena for querying s3 bucket , create table or views for report building and connect tables or views to redshift. Experience with Looker for report building purpose. Expertise in python, pyspark, sql. Note: It's a remote job. You need to connect to the client system and work ...
...scientist. You should be very comfortable taking a question or request from the business and performing the analysis using data to produce a short doc with your findings and recommendations. To do this, you need a good understanding of UX, product management, and customer experience. We want actionable insights based on the data to help us make decisions. Our data stack today includes Segment, Redshift, Google Analytics, Mixpanel, Chartio (soon to migrate), DBT, Census and Integromat to plug-in the gaps. You will be asked to answer the following questions when submitting a proposal: 1. Please tell us more about your background and work experience 2. What interested you in this role? Why are you qualified for this role? 3. How many hours per week would you be available? 4. Give ...
...platform. Are you a solid React engineer that can jump on a project and make it better than you found it? Do you enjoy collaborating with your frontend team to deliver solid, dependable features? This is a steady, long-term position that pays up to $800 per week and you can consistently make more than $3470 per month. Our stack: Front-end: React, Redux Back-end: Go, Python Databases: Postgres, Redshift Platform: Github, JIRA, Slack Code quality is very important to us, and we build quickly while keeping our projects stable and maintainable. If this is attractive to you, you might be who we're looking for. You're likely to be a good fit if you are: Detail Oriented: You hate it when the UI/UX is inconsistent. A Good Communicator: You have no problem describing a pla...
...platform. Are you a solid React engineer that can jump on a project and make it better than you found it? Do you enjoy collaborating with your frontend team to deliver solid, dependable features? This is a steady, long-term position that pays up to $800 per week and you can consistently make more than $3470 per month. Our stack: Front-end: React, Redux Back-end: Go, Python Databases: Postgres, Redshift Platform: Github, JIRA, Slack Code quality is very important to us, and we build quickly while keeping our projects stable and maintainable. If this is attractive to you, you might be who we're looking for. You're likely to be a good fit if you are: Detail Oriented: You hate it when the UI/UX is inconsistent. A Good Communicator: You have no problem describing a pla...
I need someone who can migrate my existent redshift to the snowflake.
We would like a consultation regarding rendering in Maya with the Redshift plugin. We would like to know how to maximise our Nvidia GPU for fast rendering, please. (removed by Freelancer.com Admin)
Looking for an AWS based Data engineer who can create custom python based jobs on AWS Glue, Data pipeline, Appflow and Redshift to process data with in AWS.
...on, also multiple SQL questions were asked during interview, possible the project is about conversion from SQL to cloud. Job Description: Responsibilities • Looking with experience in ETL, Python, and Data Warehousing. • Experience – 5 years in this area and overall 8 to 9 years’ experience in IT. • Develop Python data transformation modules to load data into various targets including Redshift, Teradata and Snowflake. Experience extracting data from API’s using Python. • Develop the Python ETL framework for loading data into relational databases. • Extensive knowledge Python Data manipulation libraries (Pandas, numpy, petl etc) Knowledge of Python development environment pip, Conda, Jupyter notebooks Conversant with desi...
...DynamoDB is also necessary. • Experience building secure application with Okta, Auth0, Cognito or other identity & access management solutions and implementing authorization features between multiple systems. • Experience implementing ETL processes using tools like Data Stage, Athena, Informatica, AWS Glue, etc. • Experience using AWS cloud services including API Gateway, Lambda, S3, Glue and Redshift. • Experience building and deploying cloud native applications in AWS or Azure cloud platforms. • Experience using CI/CD tools like Code pipeline, DevOps, Jenkins, Bamboo and GIT. • Experience integrating multiple data sources and databases into one central platform. • Understanding differences between multiple delivery platforms, such as mobi...
Data Warehousing Expert - Experience with Snowflake, Redshift, Teradata, Azure
...performing thorough testing and validation in order to support the accuracy of data transformations and data verification to be used by downstream applications Recommend different ways to constantly improve data reliability and quality. Job Specification (Mandatory Skills required) • Coding in Python • SQL querying • Hands-on experience in at least one of the following: AWS Glue, AWS EMR, AWS Redshift • Hands-on experience in AWS S3 • Orchestration experience of data pipelines on-premise or on the AWS cloud including automation • Hands-on experience in ETL tools, frameworks, processes • Hands-on experience working on a data warehouse • Hands-on experience working with multiple databases Good to Have • Talend • SPArk scrpting/ P...
Looking for 2 senior engineers to join the augmenting data team capacity in Professional Markets. The ideal candidate will have 6-9 years of exerience. The location of resources is in India, operating on Europe timezones. Duration: 6 months 40 hours / week required. Profile: Preferred stack: Postgresql, Redshift, Airflow, SQL, Python Strong experience in SQL and data architecture Strong experience in warehousing Have handled data engineering & management projects before
I am needing a photorealistic model of an adjustable base queen size (pictures attached) in Cinema4d - Redshift. There are a few things I would need for this project: 1. High quality material texturing 2. Detailed Components 3. Ability to animate for future projects (head and foot goes up and down) I can provide any other additional assets you need. Thanks!
Using the tables provided (Orders and Users - Attached csv's - have to create tables for them) , create the following queries (in Redshift friendly SQL if possible). Please explain your thought process through comments in the query: 1. Provide the total running sales by week for the period of 10/1/19-12/31/19, split out by order category and channel. ● Table names are Orders and Users ● Orders.completed_at is a UTC timestamp. Standardize to EST date (UTC – 5 hours), as the date of sale. ● Use the combination of Orders.order_category and user.signup_channel as the series ● Use Orders.order_total as the sales total ● Final output should have the following columns: Week, Signup Channel, Order Category, Total Running Sales 2. Provide the total running sales (i.e; total sa...
S3, RDS, DynamoDB, Redshift, Kinesis, Glue,Athena, Lambda,SNS, SQS Spark, Presto
I need entry-level training for new job search and as well project skill work
...Experience Manager (AEM) You have at least 7 years of software development experience under your belt experience in IT industry comprising of JAVA,Cloud Computing and Cloud Engineering . Good knowledge of designing, deploying and operating highly available, scalable and fault tolerant systems using Amazon Web Services ( AWS) and Azure. Hands on Experience in AWS Cloud in various AWS Services such as RedShift, Cluster, Route53 Domain configuration. Hands on experience on writing ARM Templates and chef scripts for migrating any project. Managing Amazon Web Services ( AWS) infrastructure with automation and configuration management tools such as Chef, Puppet and Ansible. Experience with designing and configuring secure Virtual Private Cloud (VPC) through private and public networks...
Hi, I need architectural implementation design for redshift cluster. It will need the following - best implementation strategy -back up rules -Iam roles -physical design
Hi there. I need some help. I have some detailed models that have been created in Maya with some redshift texturing. What I want to do is know how difficult it is to get a file which can then be used in UNITY and UNREAL - so I can pass the file to other to use as they see fit. Is this something you can help with. At the moment I just need to know if its possible - so ignore what is written down for the rate - if its something you can help me with then I would need to chat with you to discuss
We are looking for course instructors for various topics to create 4 hour video courses for us: Topics include: - Prometheus - Redshift - Zabbix - Kibana Since the videos will have your voice in them, please only apply if you have good English and a light accent.
...platform. Are you a solid React engineer that can jump on a project and make it better than you found it? Do you enjoy collaborating with your frontend team to deliver solid, dependable features? This is a steady, long-term position that pays up to $300 per week and you can consistently make more than $1200 per month. Our stack: Front-end: React, Redux Back-end: Go, Python Databases: Postgres, Redshift Platform: Github, JIRA, Slack Code quality is very important to us, and we build quickly while keeping our projects stable and maintainable. If this is attractive to you, you might be who we're looking for. You're likely to be a good fit if you are: Detail Oriented: You hate it when the UI/UX is inconsistent. A Good Communicator: You have no problem describing a pla...
Hi All, Looking for support on Hadoop, sacala, sql, frameworks such as Apache spark, olap databese snowflake or redshift Let me know if you have experience in it
...following software/tools: Coding knowledge and experience with several languages: C, C++, Java, JavaScript, etc. Knowledge and experience in statistical and data mining techniques: GLM/Regression, Random Forest, Boosting, Trees, text mining, social network analysis, etc. Experience querying databases and using statistical computer languages: R, Python, SLQ, etc. Experience using web services: Redshift, S3, Spark, DigitalOcean, etc. Experience creating and using advanced machine learning algorithms and statistics: regression, simulation, scenario analysis, modeling, clustering, decision trees, neural networks, etc. Experience analyzing data from 3rd party providers: Google Analytics, Site Catalyst, Coremetrics, Adwords, Crimson Hexagon, Facebook Insights, etc. Experience with dist...
