AbanteCart Community

Shopping Cart Operations => Support => General Support => Topic started by: buddahboy on October 28, 2013, 07:33:01 PM

Title: SOLVED - Uploading large files to download section - PLEASE
Post by: buddahboy on October 28, 2013, 07:33:01 PM
Greetings,

My php.ini on the server allows for a max of 600mb and the php.ini within AbanteCart's directory is also set for 600mb - I see in AbanteCart under system settings  that I can upload up to 600mb (screenshot attached).  I try to upload a 572mb file and get an error message  600.04 MB  Error: True  -  the file is not 600 mb.   

Any thoughts? 

Thanks,
Ron
Title: Re: Uploading files to download section
Post by: abantecart on October 28, 2013, 10:58:14 PM
Interesting. Can you post exact error you get?
Title: Re: Uploading files to download section
Post by: buddahboy on October 28, 2013, 11:59:54 PM
Thank you for your assistance - here is a screenshot of the message.  The file in question is 572mb, zip format

Appreciate your assistance. 

Title: Re: Uploading files to download section
Post by: Basara on October 29, 2013, 03:06:56 AM
Greetings,

My php.ini on the server allows for a max of 600mb and the php.ini within AbanteCart's directory is also set for 600mb - I see in AbanteCart under system settings  that I can upload up to 600mb (screenshot attached).  I try to upload a 572mb file and get an error message  600.04 MB  Error: True  -  the file is not 600 mb.   

Any thoughts? 

Thanks,
Ron

Hello. The file system allocates disk space in blocks or clusters, which typically range in size from 512 bytes to 32KB. The size occupied by the file is usually greater than its actual size, because it gets rounded up to a whole number of blocks.
Please try to upload a bit smaller file. Hope this is not a bug)))
Title: Re: Uploading files to download section
Post by: buddahboy on October 29, 2013, 10:33:22 AM
Hi Basara,

Thanks for taking the time to assist. 

This zip is a collection of volumes that are sold separately and while it is very large we have customers that buy it - I made a zip of 6 of the volumes and it came to 410MB and when uploading it to resources it showed indeed that it was rounded up to 430MB BUT it did begin to upload. 

Wanted to let you know that your thought was correct and that this is not a bug.   ;)

Once more, I appreciate the assistance - invaluable.  First site with AbanteCart and just love it BTW and reviewing it, sharing it - thanks again! 

All the best,
Ron
Title: Re: Uploading files to download section
Post by: buddahboy on October 29, 2013, 02:44:50 PM
Greetings - I spoke too soon - - as mentioned my php.ini on the server is set to 600mb, the php.ini for AbanteCart is set for 600mb (images above) - went to upload a file that is 350mb and got the error message again (screen attached).  This is far below the limit so I'm hoping I can get some assistance here.  Worse come to worse can I upload it via FTP?  Don't know how I'd do that though but I'd like to use the resource upload function if I can. 

From error log:

2013-10-28 15:43:16 - warning:  AbanteCart core v.1.1.7 unlink(/home/xxxx/public_html/AbanteCart/resources/archive/18/7a/1.zip): No such file or directory in <b>/home/xxxx/public_html/AbanteCart/core/lib/resource_manager.php</b> on line <b>203</b>

2013-10-28 15:44:33 - runtime notice:  AbanteCart core v.1.1.7 Only variables should be passed by reference in <b>/home/xxxx/public_html/AbanteCart/core/engine/resources.php</b> on line <b>84</b>

2013-10-28 15:44:33 - error:  AbanteCart core v.1.1.7 Allowed memory size of 134217728 bytes exhausted (tried to allocate 69423006 bytes) in <b>/home/xxxx/public_html/AbanteCart/core/engine/dispatcher.php</b> on line <b>308</b>

Thanks much for any assistance,
Ron
Title: Re: Uploading files to download section
Post by: abolabo on October 30, 2013, 07:08:37 AM
Greetings - I spoke too soon - - as mentioned my php.ini on the server is set to 600mb, the php.ini for AbanteCart is set for 600mb (images above) - went to upload a file that is 350mb and got the error message again (screen attached).  This is far below the limit so I'm hoping I can get some assistance here.  Worse come to worse can I upload it via FTP?  Don't know how I'd do that though but I'd like to use the resource upload function if I can. 

From error log:

2013-10-28 15:43:16 - warning:  AbanteCart core v.1.1.7 unlink(/home/xxxx/public_html/AbanteCart/resources/archive/18/7a/1.zip): No such file or directory in <b>/home/xxxx/public_html/AbanteCart/core/lib/resource_manager.php</b> on line <b>203</b>

2013-10-28 15:44:33 - runtime notice:  AbanteCart core v.1.1.7 Only variables should be passed by reference in <b>/home/xxxx/public_html/AbanteCart/core/engine/resources.php</b> on line <b>84</b>

2013-10-28 15:44:33 - error:  AbanteCart core v.1.1.7 Allowed memory size of 134217728 bytes exhausted (tried to allocate 69423006 bytes) in <b>/home/xxxx/public_html/AbanteCart/core/engine/dispatcher.php</b> on line <b>308</b>

Thanks much for any assistance,
Ron

hello.
php have two directives that can to limit upload size of file: upload_max_filesize  and post_max_size. Check both via phpinfo(); function.
Also do not forget settings of upload file size on Abantecart settings page.


Title: Re: Uploading files to download section
Post by: buddahboy on October 30, 2013, 11:00:45 AM
Good Day Abolabo,

If you look above, Oct. 28, you'll see a screenshot of the AbanteCart interface for system > settings and that files can be uploaded 600mb. 

A few days ago I had the changes made to both upload_max_filesize  and post_max_size to accommodate the same and still cannot upload large files over 100mb despite the changes made to the three files. 

Any other thoughts?  I could FTP if this is a bug or just won't work but don't know how to do that so when people buy the download the "download" function in My Account is associated with the file.  Would using the resource library "add image url or resource HTML" help as an alternative? 

Sure hope this can be straightened in some manner as I have quite a few files that are in the 250 - 350mb file range. 

Thanks for taking the time to assist me,
Ron
Title: Re: Uploading large files to download section
Post by: buddahboy on October 31, 2013, 11:30:00 AM
Anyone have some thoughts on this?  Seems all the files are set correctly with size but just won't load.  Would really appreciate some help here if someone has a solution. 

Appreciate your assistance,
Ron
Title: Re: Uploading large files to download section
Post by: junkyard on October 31, 2013, 01:47:07 PM
Quote
Allowed memory size of 134217728 bytes exhausted

With regard to this part of error,  it could be related to memory_limit = 134217728÷1024÷1024 = 128M
Not sure if raising this limit can help it or not,  though?..
See at http://php.net/manual/en/ini.core.php  :
----
[ post_max_size integer ]
Sets max size of post data allowed. This setting also affects file upload. To upload large files, this value must be larger than upload_max_filesize. If memory limit is enabled by your configure script, memory_limit also affects file uploading. Generally speaking, memory_limit should be larger than post_max_size.
-----
Also according to  https://kb.mediatemple.net/questions/1117/How+do+I+increase+the+PHP+upload+limits%3F#gs
----
If the upload_max_filesize is larger than post_max_size, you must increase post_max_size so that it is bigger than upload_max_size.
If the value of post_max_size is larger than memory_limit, you must increase memory_limit so that it is larger than post_max_size.
----
    Also check if there are any limits present for  max_input_time  or max_execution_time (if any).

Finally, if nothing helps, you could post your ~/public_html/php.ini so that the experts could see it.
And check if there are other php.ini files messing around in your directories, here is one article that mentions how there could be many php.ini
    http://www.a2hosting.com/kb/developer-corner/php/custom-php.ini-files
(also .htaccess files might have upload size limits).

Title: Re: Uploading large files to download section
Post by: buddahboy on October 31, 2013, 02:35:31 PM
Thanks Junkyard -

" it could be related to memory_limit = 134217728÷1024÷1024 = 128M" - I'll check that out but I think it is already set to that value, but not sure. 

"... upload_max_filesize is larger than post_max_size, you must increase ..."
Both are set for 600mb as is the AbanteCart php.ini and the system > settings > system field also indicates a 600mb capability rather than the previous 100mb. 

"... max_input_time  or max_execution_time..."  don't think there are but will check it out just the same. 

Thanks for the advice, I'll do some more investigating and see - will post results here nonetheless. 

All the best
Ron
Title: Re: Uploading large files to download section
Post by: junkyard on October 31, 2013, 02:40:25 PM
Quote
128M" - I'll check that out but I think it is already set to that value
Yeah but apparently this isn't enough -- try raising it further to 256MB and see if it makes the difference. The php script used for uploading files could be that memory hungry.. Cheers
Title: Re: Uploading large files to download section
Post by: buddahboy on October 31, 2013, 02:46:17 PM
Thanks again - I'll certainly try that, think you may be on to something. 

Will report back so others have a point of reference as well. 

All the best
Ron
Title: Re: Uploading large files to download section
Post by: buddahboy on October 31, 2013, 03:42:02 PM
JunkYard wrote (in part):
" it could be related to memory_limit = 134217728÷1024÷1024 = 128M"

memory upped to 196m and tried but bummed out after about 2/3 - error log:

2013-10-31 9:27:38 - warning:  AbanteCart core v.1.1.7 Invalid argument supplied for foreach() in <b>/home/xxxx/public_html/AbanteCart/admin/controller/pages/design/blocks.php</b> on line <b>552</b>

2013-10-31 9:28:15 - warning:  AbanteCart core v.1.1.7 Invalid argument supplied for foreach() in <b>/home/xxxx/public_html/AbanteCart/admin/controller/pages/design/blocks.php</b> on line <b>552</b>

In the AbanteCart php.ini there are 2 lines that I just noticed:
memory_limit = 64M;
max_execution_time = 18000;

wonder if changing memory limit to the 196m as the server side php.ini would help? 
if execution time is in seconds then that is 300 minutes and more than enough time be tons. 

Any thoughts? 

Thanks again
Ron
Title: Re: Uploading large files to download section
Post by: junkyard on October 31, 2013, 05:24:53 PM
Quote
memory upped to 196m and tried but bummed out after about 2/3 - error log
The 2 warnings seem to be not related, and the memory limit error must have gone. 
Does the 2/3 estimate mean it upped a wee bit, or there was no progress at all?

Quote
wonder if changing memory limit to the 196m as the server side php.ini would help?
FWIW, the files uploading limitation is set by the php.ini file closest to the cart's php script doing upload. Most likely it is
~/public_html/AbanteCart/php.ini.    Do you also have /public_html/php.ini ?
Title: Re: Uploading large files to download section
Post by: buddahboy on October 31, 2013, 05:36:21 PM
Quote
memory upped to 196m and tried but bummed out after about 2/3 - error log
Downloaded for a while (it showed at least half done) and then stopped

Quote
wonder if changing memory limit to the 196m as the server side php.ini would help?
FWIW, the files uploading limitation is set by the php.ini file closest to the cart's php script doing upload. Most likely it is
~/public_html/AbanteCart/php.ini.    Do you also have /public_html/php.ini ?
sure do - changes I made to it:

magic_quotes_gpc = Off;
register_globals = Off;
default_charset   = UTF-8;
memory_limit = 196M; instead of the default 64m
max_execution_time = 18000;
max_upload_filesize = 600M; instead of 100m plus it corresponds with server side php.ini
safe_mode = Off;
mysql.connect_timeout = 20;
session.use_cookies = On;
session.use_trans_sid = Off;
session.gc_maxlifetime = 12000000;

Thank you once more - was sort of hoping that it would work by now. 

Do you know how to upload via FTP for downloadable products? 

Much appreciate you taking the time for me

All the best,
Ron
Title: Re: Uploading large files to download section
Post by: junkyard on October 31, 2013, 06:21:13 PM
Quote
max_upload_filesize = 600M; instead of 100m plus it corresponds with server side php.ini
Take care the syntax there should be upload_max_filesize instead..

Also, based on  php.net/manual/en/ini.core.php#ini.post-max-size  reading, you should have
upload_max_filesize < post_max_size < memory_limit
e.g. you could try setting 600M < 650M < 700M for these three respectively.
But that will not help if your hosting provider has lower memory limit for your website themselves.

Quote
Do you know how to upload via FTP for downloadable products? 
Sorry, never used downloadable products feature before, and not planning.  Uploaded files are stored in  ~/public_html/resources/download  under different names, mapped to the cart's resources in database.  You could try placing your files there,  but then you will have to figure out the mapping (insert new rows in  both database tables manually?) -- try checking ab_downloads and ab_download_descriptions tables you will get the point.
Title: Re: Uploading large files to download section
Post by: buddahboy on October 31, 2013, 06:36:03 PM
Thanks again - I'll get back to this one over the weekend - calling it a day for now, been at it since early morning and my ever so humble brainpower is fading on me! 

I really do appreciate all the feedback, thank you. 

All the best,
Ron
Title: Re: Uploading large files to download section
Post by: llegrand on November 01, 2013, 04:55:47 PM
Hey Ron,

If you're still fighting this issue -  I had a thought about a "back-door" approach that might work until a real solution arrives.
It's a play on Junkyard's suggestion on the FTP.  I think trying to figure out what all the system needs in the database is a bit involved as it looks like it moves across several tables in the database.

So what if you make a very small sized video,  name it the same as the real one you want to use will be named.
Go in and using the small video as the upload at this point, set up all the product listing functions and save the product.   

THEN,  using your FTP go find the fake video  which I believe is located 
public_html/(folder, if any)/resources/download/ ....they seem to assign a key number to a file,  and the file is within that
and replace the file with with the real video (remember the names need to be the same).

It might be worth a try to see if you've not solved it yet.

Lee


Title: Re: Uploading large files to download section
Post by: buddahboy on November 01, 2013, 05:03:35 PM
Hi Lee,

Very interesting - makes total sense to upload the small zip file and replace it with the large one -- I'm just gonna see how the file is renamed when uploaded and then I'm good to go - simple and effective I think.  Good one! 

I'll test this out a bit later and will make the results known so if it works others may be able to get some help too. 

Thanks again Lee
Ron
Title: Re: Uploading large files to download section - PLEASE
Post by: buddahboy on November 12, 2013, 10:47:16 AM
Good Day - I'm still having some issues with finding a solution to using the standard resource upload function from within AbanteCart. 

The server and script settings are all mentioned in detail above and all seems to be good BUT AbanteCart is still not uploading the complete file.  The only viable suggestion was made by llegrand who suggested uploading a small file and replacing it via FTP with the large file renamed accordingly - this I've yet to try but it would be so much more productive and easier if the script accommodated this function especially when all the settings are correct. 

Don't know if this is a bug or not but would greatly appreciate any assistance to get this running in the standard fashion. 

All the best to one and all!
Ron
Title: Re: Uploading large files to download section - PLEASE
Post by: Basara on November 18, 2013, 08:58:56 AM
Good Day - I'm still having some issues with finding a solution to using the standard resource upload function from within AbanteCart. 

You maybe have a server-side setting preventing you to upload larger files. Even if all htacess and php.ini settings are correct many hosting providers having their own rules and regulations to php scripts and memory usage.
For example memory_limit almost all webhosts have default values regarding the amount of memory you are allowed on your account.

Please check with your hosting company to get information about what configuration changes and maximum values are allowed for You.
Title: Re: SOLVED - Uploading large files to download section - PLEASE
Post by: buddahboy on November 18, 2013, 09:31:13 AM
Good Morning Basara - no, that's not the problem as I use a VPS and the settings of memory and allowable upload size are far in excess - I upload files as large from other scripts with no problem - Joomla, Wordpress.  It is not a problem often but it will not work through the download section for some reason. 

Thank you and all the best,
Ron