script to upload from URL

script to upload from URL

Hetz Ben Hamo hetzbh at gmail.com
Wed Dec 14 09:41:55 IST 2011


Hi,

On Wed, Dec 14, 2011 at 9:25 AM, Moish <moish at mln.co.il> wrote:

> wget2web
>
>
Link?

Hetz


> On 14/12/2011 03:32, Amos Shapira wrote:
>
>> 2011/12/14 David Ronkin <dronkin at gmail.com <mailto:dronkin at gmail.com>>
>>
>>    Call it asynchronously with ajax or jquery get/post - while waiting
>>    for response you can print whatever you what.
>>
>>
>> I second that - that's, for instance, how Google's auto-completion (of
>> addresses in gmail, search terms in search etc) works - it sets a
>> background JavaScript thread which runs every second in the background,
>> reads the input field's value and submit it to the server for process if
>> it changed (and pulls the results, of course). You can skip the "check
>> input field value" part in your case. There must be some JavaScript
>> libraries which can already help you there (http://jquery.com/ is the
>> first suspect, but there must be many more lying around).
>>
>> Two less related points:
>>
>> 1. Make sure you verify the URL for any hockery-pockery (e.g. that it's
>> a genuine legitimate "http(s)://" URL and not, for instance
>> "file:///etc/passwd" or trying to break out of the shell parameter
>> quoting to inject its own shell commands or encoded javascript that can
>> be used for cross-site-scripting :)
>>
>> 2. While I'm looking for work, I might be available for such small jobs
>> (I'm not a JavaScript Guru, more of a server-side guy, but should be
>> able to do something like this with some research).
>>
>> --Amos
>>
>>
>>    David
>>
>>    --
>>    בברכה,
>>    דוד רונקין
>>    נא בקרו בבלוג שלי: http://dronkin.blogspot.com
>>    <http://dronkin.blogspot.com/>
>>
>>
>>    2011/12/13 Hetz Ben Hamo <hetzbh at gmail.com <mailto:hetzbh at gmail.com>>
>>
>>        Hi,
>>
>>        I've written a simple bash script to upload a file from a remote
>>        server as a CGI script (yes, I know, I should use another
>>        language, but it's just a proof-of-concept).
>>
>>        It goes like this: A simple HTML page gives the user a text line
>>        to enter a URL and "upload" button, which submits the data using
>>        POST to a bash script (I use the proccgi for transferring the
>>        values).
>>
>>        The scripts fetches the URL and launches wget to grab the file,
>>        rename it and move it to a specific directory.
>>
>>        So far, so good. The script works well.
>>
>>        But I have one issue with it: those files are pretty big (1-3
>>        GB) and wget doesn't show anything while it uploads - in the web
>>        browser. I tried using some redirect tricks, but it still
>>        doesn't show anything on the screen. I can redirect the output
>>        to a text file and show it after the upload, but it defeats the
>>        purpose of showing some activity.
>>
>>        So my question: how can I make WGET (or CURL) show anything on
>>        my browser while it downloads the file (uploading it to the
>> server)?
>>
>>        Thanks,
>>        Hetz
>>
>>        ______________________________**_________________
>>        Linux-il mailing list
>>        Linux-il at cs.huji.ac.il <mailto:Linux-il at cs.huji.ac.il**>
>>        http://mailman.cs.huji.ac.il/**mailman/listinfo/linux-il<http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>    ______________________________**_________________
>>    Linux-il mailing list
>>    Linux-il at cs.huji.ac.il <mailto:Linux-il at cs.huji.ac.il**>
>>    http://mailman.cs.huji.ac.il/**mailman/listinfo/linux-il<http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il>
>>
>>
>>
>>
>> --
>> View my profile on LinkedIn <http://www.linkedin.com/in/**gliderflyer<http://www.linkedin.com/in/gliderflyer>
>> >
>>
>>
>>
>> ______________________________**_________________
>> Linux-il mailing list
>> Linux-il at cs.huji.ac.il
>> http://mailman.cs.huji.ac.il/**mailman/listinfo/linux-il<http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il>
>>
>
> --
> Moish
>
>
> ______________________________**_________________
> Linux-il mailing list
> Linux-il at cs.huji.ac.il
> http://mailman.cs.huji.ac.il/**mailman/listinfo/linux-il<http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il>
>



-- 

*חץ בן חמו
חץ-ביז
*השכרה ואירוח של שרתים פיזיים
מעוניין להשתמש בשרותים שחסומים לגולש הישראלי? Hulu? NetFlix? Pandora?
Google Voice? אם כן, היכנס לכאן <http://vps.net.bz/?p=406>.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cs.huji.ac.il/pipermail/linux-il/attachments/20111214/50a158be/attachment.html>


More information about the Linux-il mailing list