C# Mix 11,000,000 records with high performance

Hello, I am VB, VBA, C#, WPF, Java, Delphi, PHP, ASP.NET, CAD and GIS developer, I developed many desktop applications and custom tools, macros and Add-Ins. For reference see my profile. I am ready to discuss and doing the project. Best regards, Eyad

How can I commit anything :) Until I will jump on your code it is difficult to understand what is there and how it is giving poor performance. So I would request you if you can please show me the problem. As soon as I will get the root cause I will give you the solution. Will wait for your message to move further.

Hello, I'm a C and C++ engineer from a hardware /high performance engineering background. Been writing C/C++ for 25 years .. For reading 11 mllion lines of text, from disk-based file, is best done using "file size", and reading that file, base don large chunks (of that file size); instead of reading it one line at a time. The data is stored in memory(8 GB is more than enough), and then all new/processed data is written to the new file(preferably in large chunks/blocks , at a time). Interested..? I can do this for you pretty quickly,

Dear Employer, I am a C# expert and will do any task related to C#. Please let me work on your requirement. Thanks and Regards, Ashish Singhal

Hello, I'm interested to work on this. Thanks for your reply. Regards, Sheik

Hi, I am ready to take this challenge out of fun. I don't need any advance money for this. If I would achieve a significant results then you can pay me. But I would need answers of below questions to start with this, 1. Have you awarded this project to someone else? Because it will be waist of time for me if you cannot wait for my results. 2. Approximately, how many unique domain name are there in your data? 3. What is current performance and how much % do you want to improve? Ping me if you see my message. Thanks Prasoon

Hello, please contact me. Xin hãy trao cho tôi dự án này. This will not be displayed to other freelancers (only to the employer).

hi, I think it is pretty simple. as you said the system has 8 Cores so if we split it into 8 parts and then using multi threading runs the same function to perform the action this will reduce the time 8 time less then the current duration. if you think i will be ok then i will be very much intrested to work. Waiting for your positive feedback. Thanks Bilal Zafar

Dear Sir, I can do this task easily as I have worked mostly on architectural and optimization of an application. I have much knowledge and experience with respect to the performance optimization of an application and can implement different techniques which can surely speed up your application.

Dear Sir, I'm writing in response to your task post. As a highly competent software specialist with more than nine years of experience , I would bring a high quality and service focused mindset to this job. Proposed Solution: Parallel Processing for mails, Special Saving technique to disk Based on my experience in: - Managing and designing projects. - Developing and debugging in many different languages like C++, C#, VB.Net, VB6, Java... - Many algorithms, design patterns, and a knack in problem solving. - Delivering with high quality based on careful testing. If I'm chosen I offer high quality software following known coding standards, and conventions. Sincerely, Mina

Hi Sir I like to work in this project. I has a solid experience in VB, VB.net , C# in programming language. I has a solid experience also in Database engine Access, SQL Server, MySQL , Oracle. I has a solid experience in reporting tools such as DataReport in VB 6, MS Report Viewer , and also crystal report. I'm waiting for your replay

Hello, I am a programmer from Romania (Europe) and I have good experience with email marketing (filtering emails and preparing campaigns). I have an algoritm in mind that will allow the emails to be sorted by domains in such a way that it will ensure the maximum possible distance between 2 emails with the same domain. This involves building a desktop app that will run in Windows (c#.Net). Cheers, Ionut

you need a good algorithm with parallelism involved that can utilize your cores and processor properly Please contact to learn more

Hi We have implemented this kind of functionality in one of our application. Our solution was : Read file in batches using parallel programming split file into multiple file and read in batches and perform read in parallel If you provide file we can implement this. Second solution: Create SSIS package which will be faster enough Thanks in Advance

hi, we need to discuss little bit, i have some questions in order to understand well and try to find the best algorithm to speed up this process

Hello, Hope you are fine. I have read your requirements, I am expert in all required skills and ready to start work immediately. Please open chat with me so we can discuss more in details. Hope we ll work together. Looking forward to hearing from you. Best Regards, Arsal

Hi, I have a few questions about your project. Please send me a message so that we can discuss more.

I understand the struggles of working with big data, but luckily for you I have experience with both .NET languages and working with big data. I made it to the finals of the Intel International Science and Engineering Fair for my work with artificial intelligence, and one of the routes I took was past pattern recognition. This required me to work with LARGE amounts of data, upwards of 100GB of data, and process it quickly. Algorithms are my specialty. I have many ideas for accomplishing this, namely splitting each domain into its separate group, and then working from there. The only difficulty I envision will be if one particular domain has more than twice the records of any other domain, which I doubt is the case. At any rate, I think it's completely doable and shouldn't be entirely too difficult. I've been a professional .NET developer for nearly three years now, working with super-computing clusters and massively parallel programs. I can allow the app to take full advantage of your computers capabilities, probably writing a multi-threaded solution so you aren't stuck on one core, if you haven't already tried that.

Hi, Got 3 years full-time on .NET and SQL Server Optimization to benchmark a Casino Gaming product to support from 500 to 15K concurrent users. 8 Years of .NET, ASP.NET Web Development full-time experience. I am happy to discuss the solution using RegEx and .NET to process with high performance.

Hello, Its a pleasure to let you know that I've Completed and Delivered similar project before. All I need to work upon customization part, if we can proceed towards more discussion. I have gone through your project description and confident to accomplish your project. I am an individual developer and you will be working directly with me if we proceed work on this project. My key skills are - 1)Ruby 2)Ruby On Rail 3)Angular JS 4)Node JS 5)PHP with Codeigniter and Laravel Framework. Let's initiate our chat so we can proceed towards conclusion of this project scope and give it a start as soon as possible. Thank & Regards Prashant Shinde