Loading Data into Database

[dpmunro]

Hi Folks,

I have test system at home and my access to my powweb package, I have uploaded the site without issue. However when I upload the mysqldump file I can't load it into the database for the site, the file is far too big to use the import function as it is 210Mb.

The file uploads to my ftp area, but from within the sql window in db admin area I am unable to use the "source" function to load it into the database. Has any one had experience of this in the past.

I'm certain that when I tested this in the past it all worked, but the file was only around 40Mb then.

Regards

Dave Munro

[Croc Hunter]

Hi Dave, You haven't been able to restore a db bigger than 10Mb here for.. forever. You can manually split the backup file or try a recursive splitter script like Bigdump. Or FTP upload (as you have) and contact support with all your details requesting they restore the db for you.

I would like to see the Powweb phpMyAdmin restore limit lifted to 100Mb but that would cause all kinds of logistical problems here. Storing images/video in a database isn't a good idea in general.

[dpmunro]

Hi Croc Hunter,

Thanks for the prompt reply, the data base dump has no images in it. It is simple text, I will try chopping the file and loading using the import function, if that doesn't work then I'll try contacting support.

Although I'm pretty sure that about October last year that "source server:/directory/path/filename" worked to load the data into the database, just I can't find the notes that I made at the time.

Regards

Dave Munro

[YvetteKuhns]

I had trouble importing a large database for an ecommerce website. I had to import one table at a time and it was from a good backup.

[Dbrazzell]

http://www.ozerov.de/bigdump.php

Ive used this a couple of times couple of times on our servers.

Be nice though. This really loads up a server :).

Pm me if you get frustrated and you keep running into limitations.
I have shell access on our servers and do this by hand with the regular mysql command line tools.

For other people in the future. You can put in a ticket to support and ask that someone in the higher levels in tech support do the import for you. Say that you cant do it in phpymyadmin due to the limit.

[YvetteKuhns]

I have posted the BigDump link many times here and requested it (in the wish list) to be available through OPS. I don't know why that hasn't happened (yet).

One time I have asked support to use a backup for a client which was much easier. The smaller databases are easier for customers but the large ones are difficult to import, especially from the client side.

[Dbrazzell]

I have posted the BigDump link many times here and requested it (in the wish list) to be available through OPS. I don't know why that hasn't happened (yet).

One time I have asked support to use a backup for a client which was much easier. The smaller databases are easier for customers but the large ones are difficult to import, especially from the client side.


Big dump is awesome :) But its really hard on the servers. So we don't exactly want to run around telling people how to abuse the servers.

Also mysql query limits are on the servers now. So using bigdump might use up all of your available queries in an instant. Not fun.

Support will help you though. Ive had to import a few 2+ gig databases for customers. Its pretty rare but they do exist. Usually by the time you reach that size your getting enough traffic in a day that you have outgrown a shared hosting environment.

[YvetteKuhns]

Thanks for the explanation for while BigDump wasn't offered "officially" in OPS. We unofficially suggest it anyway, but only if the other methods don't work.

I normally don't handle HUGE databases, but that shopping cart had a lot of products and manufactures. Only a few tables were REALLY big that would take longer to import. I could import several tables at one time that were smaller.

[kavione]

When I try to use big dump, I get this error

The server encountered an unexpected condition which prevented it from fulfilling the request.
The script had an error or it did not produce any output. If there was an error, you should be able to see it in the error log.

You can check it out here: http://kavione.powweb.com/bigdump/bigdump.php

I'm trying to move my site, www.themavenreport, over to Powweb. The database is 19.1m.

Any advise or suggestions?

[Barry441]

On your existing host try exporting your database tables in clusters to make them smaller and this may help.

I tried importing my entire database in one fell swoop amd hit the 75,000 queries limit after 5 or 10 minutes. I have split it up into 10 .sql files and all have successfully imported to my database here at PowWeb, except for #3. It is only one table (phpbb_posts) that is 34mb in size and it keeps bombing out on me.

Hopefully there is a tech in on a Sunday that can do this for me at the server.

[Barry441]

Thank you very much to Dbrazzell and the support team for helping get my db loaded up today. I've got some happy board members now.:p