I just tried to import the second file (4.58 MB), and was unable to do so (it timed out and said "processing failed" and "unable to import"). I then modified the feed to remove the long description in thinking that it was the file size possibly, but it didn't make a difference as I got the same error

Would it make any difference if I moved to a different server (with more space)?



What's next?

Maybe it's due to lack of caffeine, but I'm a bit confused. When you say "second file", are you referring to the link you posted for Upload2Site1.csv, or another file?

As far as file size as an issue, the files I've been working with are 14-18MB in size, and I've even been running those from home on a cable modem connection to make sure it wasn't a connection speed that allowed them to work here. File size does not have as much of an impact on an import as the number of products in the file that have to be processed. I know there are a couple of threads regarding issues uploading larger files that would seem to tie in with this, but that is actually an unrelated issue that does not have any connection to import/export issues.

I tried that one...but it didn't work. I then cut up the file so that it was only a nine product update for existing products, and it worked (after a full minute for a 17KB file). I then tried an import with 1,000 products, and it failed. I then tried 500 products and that failed as well.

My problem is that since it isn't about file size, but rather the product number, I am going to have to perform HUNDREDS of monthly imports if it doesn't get fixed, and that isn't really an option. Although I only need to import a couple different fields (mainly the stock quantity), this apparently doesn't matter because it is about the number of products...

As I have stated before, this has only been a problem since the 7.3 update so I truly believe that it is something that can be fixed... However, I am at a loss at what to do.

I'll look forward to your response.

Alright, so I just tried the 1000 products again and it actually worked with errors. The CSV error statement had the following message for 134 products:

Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding.

I guess I don't quite understand, because I was active on the MCP during this time, and you said that it doesn't time out on your end...any ideas?

OK, this is actually good from a troubleshooting perspective as this is the same error I get with the file you originally uploaded to your site on the 20th.

Now, here's what I'd like to try:
1. Export the Audio category from your site, but when prompted, do not open the file, just save it someplace. This is 2286 products, so it's larger than the files you've been working with.
2. Import this file back into your site with no changes.
3. If this full import fails without providing an error file, drop the file to 1000 products and see what that does. No, I'm not suggesting you will need to only do 1000 at a time, just trying to troubleshoot some things to get a better feel for how your live site may differ from my test environment. Make sure when you open it in Excel that you format the part number field as text as excel likes to try and change it to scientific notation instead. I noticed several part numbers on your site in this format, so I'm guessing you've used Excel in the past to edit your import files.
3a. If the import fails with an error file, what errors?

If either of the above imports work, please send me your file that is failing so I can compare the formats for any minor differences.

I look forward to hearing your results.

Hi, the import ALMOST worked...

I got a small amount of products with the error that said they must belong to at least 1 category. However, in looking at the products, the strangest thing happened...they weren't my products.

I have put the error file on my file manager as "ErrorsInAudio". I checked the part number, manufacturer, and I don't carry any of those products...I assume they are from another store on my server?

Let me know what you find out.

Not your products? Strange indeed. I'll take a look at the error file you uploaded and get right back to you.

Thanks...unless I am missing something, I am baffled...

Here is my fix for this problem,and it works.
1) upload your product file.
2) when you get a failed message, click the box that says error report.
3) save this file as a new file on your computer
4) open this file, and delete the column with the error messages.
5) save this file as a new file, then upload this file.
What you are doing now is only uploading the files that had an error.
Continue doing this until all files are loaded.
I started with 800 products, then the error report had 166 that did not load. I saved this, uploaded again and it went to 110 not loaded. I just kept repeating only the errors.

OK, so basically you opened an error file for another import that failed instead of getting your error file. Don't worry, the other import was not being run against your site, it's a timing issue that has to do with how the error file gets named when it is saved to the server. We've know what caused this and have logged this as a bug that is being corrected.

Would it be possible for you to run the import again so we can see what your errors were?

Yeah, I am doing it right now (and will return home and let you know the results in about 2 hours as I am heading out).

Thanks.

This time I am not able to import (the default "processing failed") message. I am guessing it was a time of day thing?

Should I try a smaller size? What should I drop it down to?

OK, I dropped it to 500 products, and got the same error message.

I then dropped it to 100 products, and after about 20 minutes of processing, it finally completed with an error message in which two items got the following error:



Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding.

Any news?

Sorry, I'm doing some more testing on my end and am still trying to replicate the same issues you are getting.

OK thanks. I'll look forward to hearing from you.

OK, I've done a bit of testing and things seem to be working a little better on your site. I am able to get pretty large exports going much better, and would like you to try the audio category import again. As before, please export the category and then re-import the file that is generated.

Hi, I just tried to do the entire audio category and it failed. I will try once more tonight and let you know how it goes

Hi,

Good news! I tried last night to do a 1000 product import, and when I woke up this morning, it had failed.

However, I tried again this morning and it worked. EVEN BETTER, I then re-exported the audio category and tried to import it and it worked! I am guessing time of day makes a difference.

Great job! Now what is next?

Alright, I just tried one of my uploads, and then 2500 didn't work, but I then tried 1000 and it worked (IMG:http://forums.networksolutions.com/style_emoticons/default/smile.gif)

Now if we can just get some consistency and a little bit larger of product numbers updated...Is that something that you think is possible?

Alright, I just got a new error message trying to upload 1000 products:

Transaction (Process ID 144) was deadlocked on lock resources with another process and has been chosen as the deadlock victim. Rerun the transaction.

About 25 records had this error message...

Sorry for the delay in getting back to you, I was out of the office on Friday.

So, sounds like some good progress, but not quite what I was expecting based on what I am seeing on my end. Now, just to make sure I understand your last two posts correctly, was the import you were trying there one of your files, or one of our export files? The way I'm reading this, it sounds like one of your files, and that possibly the export file we've been working with is still working properly? Or is the whole process intermittent regardless of whether you are using a file exported from your site or one of your files you normally use?

It is regardless of whether I do a quick export of the site category, and then just try to import it without modifying...

I am getting ready to do another monthly import so I would hope this time we will be able to.

Thanks for your help.