Using Conga to get text files?

[Budgie]

I want to get hold of the data out of some plain text files which are normally accessed by web browser. These files do not contain any HTML code, and Conga's HTTPGet function returns "404 page not found".

For an idea of what I'm trying to do, a specimen url is http://www.leyland.vispa.com/numth/fact ... bn/9+7.txt

There are far too many "web pages" like this out there, and I don't want to have to download them manually every time. Can anyone suggest a way of using Conga to get hold of this data?

Thanks.

[kai]

Your problem is not related to the file type or extension. Any file will be delivered by Conga.

When you get a 404 the URL is wrong.

[kai]

Sorry, pressed "Submit" accidentally.

That's what I thought when I read your message.

Trying the URL in a browser results in the data you are obviously looking for. Trying the same thing with Conga leads to a 404. Interesting. Dyalog should look into this.

Using a .NET solution:
http://aplwiki.com/GetViaHttp
works fine.

Kai

[AndyS|Dyalog]

Hi Jane

I had very similar problems myself last week .. my solution was to amend Samples.HTTPGet so that the command sent to the server was

      'GET ',page,' HTTP/1.1',NL,'Host: ',host,NL,'Accept: */*',NL,NL

rather than

      'GET ',page,' HTTP/1.1',NL,'Host: ',host,':',⍕port,auth,NL,NL

It seems that some web servers insist on having the "Accept: */*" header, and that others get very upset when you include anything but a very simple "Host: hostname" header.

Other symptoms have included getting unexpected 301 and 302 errors.

I'm off today (which begs the question what am I doing looking at my email ?), and intend to make the most of what is an absolutely fabulous autumnal day in this part of the world ! However, I'll take a longer look tomorrow.

[Brian|Dyalog]

Andy is quite right...

Apache seems fussy about having the port specified. Modifying line [33] of HTTPGet will do the trick.
The addition of Accept: */* isn't necessary in this case, but probably a good idea in any event.

Original:
[33] :AndIf 0=⊃r←DRC.Send cmd('GET ',page,' HTTP/1.1',NL,'Host: ',host,':',⍕port,auth,NL,NL)

Modified:
[33] :AndIf 0=⊃r←DRC.Send cmd('GET ',page,' HTTP/1.1',NL,'Host: ',host,NL,'Accept: */*',auth,NL,NL)

Hope this helps...
/Brian Becker