Csv Organizing Programmer Expert

Hello, I'd be glad to implement the Python tool for you. looking forward to chat with you soon for more details. Best regards,

Hi, I am a PhD student in Computer Science with several years of experience in industry. Let me know if you would like to discuss further and i can give you a better estimate on price and timeline. CHeers

Hi there, I'm a professional big data application developer. I can help you with this sorting task. Ping me for discussion.

Good Morning, I'm a bit confused by your project description. First line says you have 318m files, but later in the description it says 648 files with approx 595k lines each. Can you clarify this a bit? Also, what sort of data is within the CSV files? Depending on the data-types it might be best to build a script to load the data incrementally into MySQL and use it for sorting functions, then output it back to CSV. As for encryption, we definitely can encrypt it however with this large amount of data it will add to the processing power requirement of sorting exponentially. Thanks! Keith

Hi, Yes, I have experience in Large Data files. Please share the detail. I can start working today. Thanks Regards Ashok

Dear sir/madam, I am experienced developer (please check my freelancer profile and customer reviews for more details) and probably I can complete this project for you. Please provide more details about CSV structure and some examples. What did you mean by 318M files? I assume you have 318M records in 648 files . We can discuss all details in the private chat. Please do not hesitate to leave any information or questions in the private messages even when if I am offline , be sure, I will read them and respond to you as soon as possible. Please do not hesitate to ask me any questions you need to make sure I am the right person for this project.

Hello! I am a professional programmer with many years of data mining experience using Python. I have read your project description, and I can create the CSV Organization program you require. I have written many, many CSV based programs in the past, and I would be happy to show examples. Please contact me so we may speak further and so I can send files. Thank you for your consideration.

Hi, I offer you a better solution. I can import all your data into a back end MySQL database and can give a small PHP utility that will allow you to list the data off the database in any column order (L, J or ZIP) you want, as well as bulk deleting. This will also serve your encryption purpose as the data will reside in a professional database, not in some clear text flat file. This will also make the data more organized. You will also be able to import any new data file at any time. The application will be a PHP/MySQL solution and can be hosted on your own PC locally that will make the data transfer fastest (however, you can also put it on the web if you want to access the data over the internet from anywhere). In order to do this, I need some of the sample data files. I hope you like my idea. Regards, Joy

Hi, I've got some experience working with C, C++ and MySQL. I think I can help you out with this task if you need all the csv entries stored in a MySQL db, since MySQL will make it easier to sort and arrange data however you like. May I get some more details over the chat?

Hi, I can sort it on my PC, i have a lot of ram with small python script. Please explain more points 4-6.

Hi, I, based on my 5 years experience as a software engineer knowledgeable with unix and linux Administration expert on commandline application, can take good care of your project. In fact, I already done to many related to your project and please also check my profile reviews. Moreover, I love to discuss further on your requirements so we can discuss and we can move forward to the next step. Thanks, Joseph C Ocero

Hi there - My name is Anton. I’ve read your brief and can see that you’d like to build. I'm has 7 years experience designing and developing. I would approach your project by starting with wireframes and getting the design completed, before starting the actual development phase. I am highly qualified for this project and would love to speak with you further about taking this project on. Thank you for attention. I am waiting for your answer in the chat.

hello, can you give me one smaller file of 648 files, to try it, then I will be able to estimate it and say precise price and time.

Dear Client I am an experienced IT Professional for such kinds of tasks. I have reviewed your job in detail and ready to proceed to it. Please let me know if you have any questions. Warm Regards Zulfiqar

My previous job involved a lot of data manipulation and scrubbing through programming as well as through Excel. I'm also accustomed to using Python for data scrubbing and sifting over large files.

Yes, it is possible to encrypt the data. There are some caveats, we'll discuss them if I'm awarded. It's possible to do everything you have listed in MySQL also. I'm not going to lie, it won't be very fast or responsive and you're going to need to run this on properly spec'd hardware also. I'd want to write a PERL script to read() the files in chunks or by appropriate module if there is one that runs well on the target OS. Getting those files written into the database is going to be about half of the time required, waiting on sorting and debugging database server issues when sorting crashes the server is the other half. There's a lot of hurry up and wait in this one.

Hi! I have never worked with such a huge set of csv files but I know how to handle files that do not fit into memory so iz would be a very interesting project. A little more background would be nice to understand how you finally want to access this data (random access? searching for specific IDs? ...) Because I would assume that importing the data into a database would make things a lot easier but this depends on your usage scenario. best regards Thomas

Worked on extremely large files even importing the files in a database as well as csv files. Sorting etc is a very easy task. Which type of encryption you require. Contact for more details. +91-9069133779

I am an experienced cross platform application developer with 6+ years of experience in developing Python apps. For this project, I suggest writing scripts to read all csv files, and create one big file. Then put that data in a database (considering the format remains the same). Once in the database, any column can be sorted using SQL queries (can be executed from Python too).

I believe the best option is to import the files into a database. From there we can sort an re order the data and export again. I believe that with my wealth of experience I can get the job done. Looking forward to hear from you soon.