Search results

Yes this is US EPA data. I will be analyzing it to perform Hazardous Waste Market analysis for customers. I find it a little disappointing that the EPA doesn't have simple data integrity such as Natural Key (ManifestNum, LineNum). I found the same lack of data integrity in Canada. I assume...

You are right skipping the duplicated records in C# was a poor choice. I now run a removeDuplicate query after all the data is imported. Thanks. My current approach is to Truncate the Table, remove all indexes, import data, remove dups, recreate indexes. On Monday a fresh data dump is...

Will do. Thank you Isaac.

I could tell it was slower with the Natural Key index in place and decided to drop the index prior to the import and recreate the index after import in C#. How about table relationships? Do you recommend I strip those out too? Thank you

Interesting. I just ran into this. I started creating indexes and noticed the Natural Key (ManifestNum, LineNum) had duplicates. I am re-running the import but I am skipping the records that are duplicates while keeping the Natural Key index in place. I want to see how much longer it will...

It took ~33 minutes to import all the files (31,125,943 records) into SQL Server using the C# console program. It's probably slower than other techniques but for my use case this is sufficient and I have full control over the import. Thanks again for everyone's feedback.

Those were the files provided by the US government which I need to import into my custom SQL Server Table

I was successfully able to import multiple files using a C# console program. It works really well and gives me full control. Thank you for everyone's assistance. Knowing about the BCP option will come in handy in the future I am sure.

I was trying to replicate outputting a simple person table with the above characteristics; all fields enclosed with "" and can support "," within the data. I was not able to accomplish this type of output when studying the switches. Finally, I asked ChatGPT if the files are created by BCP and...

I have been studying BCP. I don't believe the output files are created by BCP, hence, it's making it hard for me to import using BCP. Below are the first 2 records in the .csv file. Do you still recommend proceeding with BCP? Thank you "MANIFEST TRACKING NUMBER","UPDATED DATE","SHIPPED...

Thanks. BCP appears to be what I am looking for. Appreciate your response.

Hello, I have a zip file that contains 31 .csv files. Each .csv file contains 1 mil records and the totality of the files makes the entire table. (This dataset is provided by the US Government) How would you go about importing this data into SQL Server? When I import one .csv file using...

George the cost is for the entire app... you can have as many users as you want. The more users and more complexity the more server power you need to buy. You are just paying for server power which you can adjust as needed. There is no licensing involved at all with Azure and the Blazor /...

The $100 is for a single application and includes the Web Server, SQL Server and the SSL Certificate. You control the costs in Azure by choosing the power of the Servers you would like. I buy the Domain Names on GoDaddy. For simple CRUD apps I am paying ~$18.25 USD / month and this includes...

MudBlazor's free UI library is the key to all this. The community is open source and very friendly. https://mudblazor.com/docs/overview https://themes.arctechonline.tech/

The only cost is hosting on Azure. Visual Studio and all the Libraries are free. For around $20 / month you can support a small Web App with CRUD and basic querying. I typically spend around $100 - $150 / month for better performance. Deployment to Azure is simply clicking the deploy button...

Yes. I use it with SQL Server on Azure. I have migrated our reporting product to Microsoft Blazor and the results are fantastic. I have also built a small project that has CRUD also hosted on Azure with SQL Server.

I have been migrating my MS Access applications to Microsoft's latest .NET technology called Blazor. In combination with the MudBlazor open source library I have been able to create excellent results. I find developing in Visual Studio / .NET / Blazor / MudBlazor very rapid and this is the...

I don't import Excel directly into SQL Server anymore. I first import into MS Access, cleanup the data in MS Access and then import into SQL Server using the Migration Assistant. The Migration Assistant creates the indexes and the timestamp field for me. This appears to be the best approach...

OK, I'll stick with Decimal(9,6). Thank you everyone.