Re: [NF] Retrieving Data from a Web Site

Author: Ted Roche

Posted: 2014-12-18 at 22:00:15

On Thu, Dec 18, 2014 at 7:34 PM, Jeff Johnson <jeff@san-dc.com> wrote:

>

>

>>> Dan: This is a web application written in (I'm guessing) .NET.

What makes you think that? Lots of bad apps can be written in Perl or even

Python.

Inspecting the actual page source can give you some good clues.

> When accessing pages it does not display any URL's.

There's a lot of ways to do that, and to undo it, too. If it appears on a

page, it can be copied. Once again, viewing the source can tell you a lot.

However, sometimes it's cheaper to pay someone to type it back in than to

automate it. Paying someone to screen-shot every page and type it into a

new system (via Mechanical Turk, for example) can be very inexpensive. An

alternative to consider, if all else fails.

There is no way to access the data through a browser. The data is in SQL

Server but the application hides their methods.

Your client may be over a barrel. It's worth reviewing his contract with

this site, and getting a lawyer to review. You don't want to go blasting

over their site with a bot if that gives them the right to cancel your

access.

Ted Roche & Associates, LLC

http://www.tedroche.com

--- StripMime Report -- processed MIME parts ---

multipart/alternative

text/plain (text body -- kept)

text/html

---

_______________________________________________

Post Messages to: ProFox@leafe.com

Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox

OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech

Searchable Archive: http://leafe.com/archives/search/profox

This message: http://leafe.com/archives/byMID/profox/CACW6n4uS5dARuMxnVHdms1iJqU3iL5YmNa6qEBGAUnzCV24gGQ@mail.gmail.com

** All postings, unless explicitly stated otherwise, are the opinions of the author, and do not constitute legal or medical advice. This statement is added to the messages for those lawyers who are too stupid to see the obvious.

©2014 Ted Roche