script to upload from URL

[Amos Shapira]

2011/12/14 David Ronkin <dronkin at gmail.com>

> Call it asynchronously with ajax or jquery get/post - while waiting for
> response you can print whatever you what.
>

I second that - that's, for instance, how Google's auto-completion (of
addresses in gmail, search terms in search etc) works - it sets a
background JavaScript thread which runs every second in the background,
reads the input field's value and submit it to the server for process if it
changed (and pulls the results, of course). You can skip the "check input
field value" part in your case. There must be some JavaScript libraries
which can already help you there (http://jquery.com/ is the first suspect,
but there must be many more lying around).

Two less related points:

1. Make sure you verify the URL for any hockery-pockery (e.g. that it's a
genuine legitimate "http(s)://" URL and not, for instance
"file:///etc/passwd" or trying to break out of the shell parameter quoting
to inject its own shell commands or encoded javascript that can be used for
cross-site-scripting :)

2. While I'm looking for work, I might be available for such small jobs
(I'm not a JavaScript Guru, more of a server-side guy, but should be able
to do something like this with some research).

--Amos


>
> David
>
>  --
> בברכה,
> דוד רונקין
> נא בקרו בבלוג שלי: http://dronkin.blogspot.com
>
>
> 2011/12/13 Hetz Ben Hamo <hetzbh at gmail.com>
>
>> Hi,
>>
>> I've written a simple bash script to upload a file from a remote server
>> as a CGI script (yes, I know, I should use another language, but it's just
>> a proof-of-concept).
>>
>> It goes like this: A simple HTML page gives the user a text line to enter
>> a URL and "upload" button, which submits the data using POST to a bash
>> script (I use the proccgi for transferring the values).
>>
>> The scripts fetches the URL and launches wget to grab the file, rename it
>> and move it to a specific directory.
>>
>> So far, so good. The script works well.
>>
>> But I have one issue with it: those files are pretty big (1-3 GB) and
>> wget doesn't show anything while it uploads - in the web browser. I tried
>> using some redirect tricks, but it still doesn't show anything on the
>> screen. I can redirect the output to a text file and show it after the
>> upload, but it defeats the purpose of showing some activity.
>>
>> So my question: how can I make WGET (or CURL) show anything on my browser
>> while it downloads the file (uploading it to the server)?
>>
>> Thanks,
>> Hetz
>>
>> _______________________________________________
>> Linux-il mailing list
>> Linux-il at cs.huji.ac.il
>> http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
>>
>>
>
>
>
>
>
>
>
>
> _______________________________________________
> Linux-il mailing list
> Linux-il at cs.huji.ac.il
> http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
>
>


-- 
 [image: View my profile on LinkedIn]
<http://www.linkedin.com/in/gliderflyer>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cs.huji.ac.il/pipermail/linux-il/attachments/20111214/6e0b57f6/attachment-0001.html>