|
Latest Discussions
|
 |
|
|
|
|
 |
|
|
Support Forum
|
|
|
| Author |
Messages |
|
Brad Schafer
Posts:8
 |
| 02/11/2010 1:33 PM |
|
Is there a log being generated somewhere on the scheduler for the Amazon S3?
I have some file that have made it into the S3, and hundreds others that have not.
The scheduler says successful but operates for less than 1 second.
I am wondering why files are no longer being added, and how I can check if there are errors.
Thanks,
Brad |
|
|
|
|
Pengtsen R
Posts:9386
|
| 02/11/2010 1:34 PM |
|
yes, in site root folder, you can find AWSOperationLog.txt.
if you can't understand it please tell me your domain and I'll check it. |
|
Pengtsen R
http://www.bizmodules.net |
|
|
Brad Schafer
Posts:8
|
| 02/11/2010 1:46 PM |
|
1. It seems there's an error sending it. I am on a very, very fat pipe so this seems odd.
Here is the error:
2/11/2010 12:47:45 PM Portals/0/UltraVideoGallery/host/b1d933a1-add3-4bcc-a074-d53cc20bcd85.mp4 -> Affirma.ThreeSharp.ThreeSharpException: The operation has timed out ---> System.Net.WebException: The operation has timed out
at System.Net.HttpWebRequest.GetResponse()
at Affirma.ThreeSharp.Query.ThreeSharpQuery.Invoke[T](Request request)
--- End of inner exception stack trace ---
at Affirma.ThreeSharp.Query.ThreeSharpQuery.Invoke[T](Request request)
at Affirma.ThreeSharp.Query.ThreeSharpQuery.BucketList(BucketListRequest request)
at BizModules.UltraVideoGallery.Scheduling.AWSOperationScheduler.UploadFile(String bucket, String basePath, String filename, String portalHome, String& key)
2. What is also strange is that 'partial uploads' are still in the folder and are also trying to be sent. These are files that have no GUID assisgned and are not in the UVG db.
a. is there a cleanup mechanism for this?
b. should I simply remove all the non-GUID files from the folder for now?
|
|
|
|
|
Pengtsen R
Posts:9386
|
| 02/12/2010 9:43 AM |
|
1, what's your batch quantity? try to set it to a smaller value.
2, please manually delete all of them, I'm not sure where it comes from |
|
Pengtsen R
http://www.bizmodules.net |
|
|
Marc Huijbregts
Posts:139
|
| 03/09/2010 1:24 PM |
|
Sorry for hijacking this posting but I am suffering from the same issue.
The log file AWSOperationLog is showing a large number of entries for the previously mentioned issue: "Affirma.ThreeSharp.ThreeSharpException" (this error is also noticable in the UMG log file AWSOperationLog_UMG).
In my case the batch quantity has been set to 10 (and 20 for UMG which I have changed to 10. I'll keep you informed). I am using DNN523 and UMG601 with the S3 option enabled and the task in the scheduler has been set to run every 30 minutes.
Any suggestions are appreciated. |
|
Regards,
Marc
www.biservices.eu for free nl-NL resourcepacks (incl. UMG 6.5.3 & UVG 3.2.1). |
|
|
Marc Huijbregts
Posts:139
|
| 03/10/2010 6:15 AM |
|
I noticed that the videos are not transferred to Amazon S3 whereas 4 images from my UMG module have been transferred to Amazon S3.
Does anyone know how to get passed this challenge? |
|
Regards,
Marc
www.biservices.eu for free nl-NL resourcepacks (incl. UMG 6.5.3 & UVG 3.2.1). |
|
|
Pengtsen R
Posts:9386
|
| 03/10/2010 10:33 AM |
|
| please try to set batch quantity to 2 or even 1, to see if you still have this problem. |
|
Pengtsen R
http://www.bizmodules.net |
|
|
Marc Huijbregts
Posts:139
|
| 03/10/2010 2:12 PM |
|
I have set the number of files to transfer to two for both UMG and UVG and the following entries were logged in the log files.
UVG:
3/10/2010 3:13:56 PM Portals/3/UltraVideoGallery/pietjepuk/66b3bc22-bdeb-472c-9376-dc363ac4ff4e.flv -> Affirma.ThreeSharp.ThreeSharpException: Thread was being aborted. ---> System.Threading.ThreadAbortException: Thread was being aborted.
at System.Threading.WaitHandle.WaitOneNative(SafeWaitHandle waitHandle, UInt32 millisecondsTimeout, Boolean hasThreadAffinity, Boolean exitContext)
at System.Threading.WaitHandle.WaitOne(Int64 timeout, Boolean exitContext)
at System.Threading.WaitHandle.WaitOne(Int32 millisecondsTimeout, Boolean exitContext)
at System.Net.LazyAsyncResult.WaitForCompletion(Boolean snap)
at System.Net.Connection.SubmitRequest(HttpWebRequest request)
at System.Net.ServicePoint.SubmitRequest(HttpWebRequest request, String connName)
at System.Net.HttpWebRequest.SubmitRequest(ServicePoint servicePoint)
at System.Net.HttpWebRequest.GetRequestStream(TransportContext& context)
at System.Net.HttpWebRequest.GetRequestStream()
at Affirma.ThreeSharp.Query.ThreeSharpQuery.GenerateAndSendHttpWebRequest(Request request)
at Affirma.ThreeSharp.Query.ThreeSharpQuery.Invoke[T](Request request)
--- End of inner exception stack trace ---
at Affirma.ThreeSharp.Query.ThreeSharpQuery.Invoke[T](Request request)
at Affirma.ThreeSharp.Query.ThreeSharpQuery.ObjectAdd(ObjectAddRequest request)
at BizModules.UltraVideoGallery.Scheduling.AWSOperationScheduler.UploadFile(String bucket, String basePath, String filename, String portalHome, String& key)
UMG:
3/10/2010 3:13:56 PM Portals/3/UltraPhotoGallery/864/51/thumbs/Donateursbal_008.JPG -> Affirma.ThreeSharp.ThreeSharpException: Thread was being aborted. ---> System.Threading.ThreadAbortException: Thread was being aborted.
at System.Threading.WaitHandle.WaitOneNative(SafeWaitHandle waitHandle, UInt32 millisecondsTimeout, Boolean hasThreadAffinity, Boolean exitContext)
at System.Threading.WaitHandle.WaitOne(Int64 timeout, Boolean exitContext)
at System.Threading.WaitHandle.WaitOne(Int32 millisecondsTimeout, Boolean exitContext)
at System.Net.LazyAsyncResult.WaitForCompletion(Boolean snap)
at System.Net.Connection.SubmitRequest(HttpWebRequest request)
at System.Net.ServicePoint.SubmitRequest(HttpWebRequest request, String connName)
at System.Net.HttpWebRequest.SubmitRequest(ServicePoint servicePoint)
at System.Net.HttpWebRequest.GetRequestStream(TransportContext& context)
at System.Net.HttpWebRequest.GetRequestStream()
at Affirma.ThreeSharp.Query.ThreeSharpQuery.GenerateAndSendHttpWebRequest(Request request)
at Affirma.ThreeSharp.Query.ThreeSharpQuery.Invoke[T](Request request)
--- End of inner exception stack trace ---
at Affirma.ThreeSharp.Query.ThreeSharpQuery.Invoke[T](Request request)
at Affirma.ThreeSharp.Query.ThreeSharpQuery.ObjectAdd(ObjectAddRequest request)
at BizModules.UltraPhotoGallery.Scheduling.AWSOperationScheduler.UploadFile(String basePath, String filename, String portalHome, String& key)
Thanks in advance. |
|
Regards,
Marc
www.biservices.eu for free nl-NL resourcepacks (incl. UMG 6.5.3 & UVG 3.2.1). |
|
|
Marc Huijbregts
Posts:139
|
| 03/11/2010 12:01 AM |
|
Since my last posting there have been uploaded 5/6 images for UMG and no videos for UVG. The reason for this remain the above mentioned entries in the log files.
I'll set the batch size to 1 to see whether this will make a difference or not. I'll keep your posted. |
|
Regards,
Marc
www.biservices.eu for free nl-NL resourcepacks (incl. UMG 6.5.3 & UVG 3.2.1). |
|
|
Pengtsen R
Posts:9386
|
| 03/11/2010 8:42 AM |
|
| ok. |
|
Pengtsen R
http://www.bizmodules.net |
|
|
Marc Huijbregts
Posts:139
|
| 03/11/2010 11:37 AM |
|
I just got home and noticed that the number of transferrred files is still the same as this morning. So even setting this back to 1 didn't get the upload process running successfully.
Is there something else you would like me to try? |
|
Regards,
Marc
www.biservices.eu for free nl-NL resourcepacks (incl. UMG 6.5.3 & UVG 3.2.1). |
|
|
Pengtsen R
Posts:9386
|
| 03/12/2010 8:56 AM |
|
I found the problem, UVG trys to transfer video 32, but the mp4 version of this video is missing, so it won't succeed and the next videos never got a chance to be transfered.
please check why the mp4 version is missing. |
|
Pengtsen R
http://www.bizmodules.net |
|
|
Marc Huijbregts
Posts:139
|
| 03/12/2010 9:43 AM |
|
I am using the accompanying UVG converter 3 to upload the videos to my website. So I don't know why it is not up in the directory. In the logs for UVG I noticed a difference since early this morning and this is that it is showing the message that the mp4 file is missing. It wasn't there before; only the previous mentioned log entries.
I deleted the video that was mentioned in the log. It was a video that was upload manually without the use of the UVG convertor. I'll let you know what happens with the remaining videos.
The bright side is that UMG seems to be going (1 image at the time), so I'll be increasing the number to pick up some speed in the transfer process. |
|
Regards,
Marc
www.biservices.eu for free nl-NL resourcepacks (incl. UMG 6.5.3 & UVG 3.2.1). |
|
|
Marc Huijbregts
Posts:139
|
| 03/13/2010 1:12 AM |
|
[quote]Posted By Pengtsen R on 03/12/2010 8:56 AM
please check why the mp4 version is missing.[/quote]
Hi Pengtsen,
I have uploaded my videos with the UVG converter and when looking in the user directory where the flv files are located I don't see any mp4 files. Should these be uploaded to the server also? If so, could this then be an issue with the UVG converter tool?
In the meantime I am getting the same timeout event viewer entry again and both UVG and UMG stopped transfering files to Amazon S3.
Is there something else you would like me to do? |
|
Regards,
Marc
www.biservices.eu for free nl-NL resourcepacks (incl. UMG 6.5.3 & UVG 3.2.1). |
|
|
Pengtsen R
Posts:9386
|
| 03/15/2010 10:16 AM |
|
so we need to check the missing mp4 issue at first.
please give me your host account, I'll try to upload a video to test it. |
|
Pengtsen R
http://www.bizmodules.net |
|
|
Marc Huijbregts
Posts:139
|
| 03/15/2010 12:10 PM |
|
I'll send you the credentials.
Thanks |
|
Regards,
Marc
www.biservices.eu for free nl-NL resourcepacks (incl. UMG 6.5.3 & UVG 3.2.1). |
|
|
Pengtsen R
Posts:9386
|
| 03/18/2010 8:53 PM |
|
| ok |
|
Pengtsen R
http://www.bizmodules.net |
|
|
Marc Huijbregts
Posts:139
|
| 03/30/2010 5:00 PM |
|
Hi Pengtsen,
Sorry for my late reply but things were mixed up between UMG and UVG. As a result I waited to have my DNN installation to upload around 1,900 images to Amazon S3 and now I can to focus on UVG. The time-out has been set to 1800 so this shouldn’t be an issue anymore.
After deleting all the videos on my DNN installation I uploaded another on with the UVG converter and I bumped into the same issue as before. The log is mentioning that an mp4 file is not present (which is true) on the server. Should this mp4 file not be uploaded by the converter?
Please find the entry of the log below:
3/30/2010 5:50:55 PM Prepare to upload video 'Eten bij Juten'(ID=48)
3/30/2010 5:50:55 PM Portals/3/UltraVideoGallery/user/634055892188784396.gif -> http://website.s3.amazonaws.com/user/634055892188784396.gif OK
3/30/2010 5:51:02 PM Portals/3/UltraVideoGallery/user/c55b753c-650f-4ae4-a409-2fb8bcfcf788.flv -> http://website.s3.amazonaws.com/user/c55b753c-650f-4ae4-a409-2fb8bcfcf788.flv OK
3/30/2010 5:51:02 PM Portals/3/UltraVideoGallery/user/c55b753c-650f-4ae4-a409-2fb8bcfcf788.mp4 -> System.IO.FileNotFoundException: Could not find file 'W:\Domains\qliktcom\website.com\wwwroot\Portals\3\UltraVideoGallery\user\c55b753c-650f-4ae4-a409-2fb8bcfcf788.mp4'.
File name: 'W:\Domains\qliktcom\website.com\wwwroot\Portals\3\UltraVideoGallery\user\c55b753c-650f-4ae4-a409-2fb8bcfcf788.mp4'
at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy)
at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share)
at Affirma.ThreeSharp.Model.Request.LoadStreamWithFile(String localfile, String contentType)
at Affirma.ThreeSharp.Model.Request.LoadStreamWithFile(String localfile)
at BizModules.UltraVideoGallery.Scheduling.AWSOperationScheduler.UploadFile(String bucket, String basePath, String filename, String portalHome, String& key)
3/30/2010 5:51:02 PM Failed to upload video 'Eten bij Juten'(ID=48)
|
|
Regards,
Marc
www.biservices.eu for free nl-NL resourcepacks (incl. UMG 6.5.3 & UVG 3.2.1). |
|
|
Pengtsen R
Posts:9386
|
| 04/01/2010 6:50 AM |
|
| please email me your host account, and include a link to this post, I'll check your database to see if UVG consider the mp4 file exist. |
|
Pengtsen R
http://www.bizmodules.net |
|
|
|
| You are not authorized to post a reply. |
|
|
|
|
|
|
|
 |
 |
|
 |
|