bwilliams
3a06132071
internal/eusupply replaces the old Node scraper (eu-supply.js) for uk.eu-supply.com. The site has no API, so it posts the public search form, which now needs the form's current defaults and reads the HTML with golang.org/x/net/html. Each tender not stored yet has its own page read too, for its description, contract type, CPV codes and buyer address. Tenders are stored with the source "EU Supply - UK" as eusupply-uk-<tender id>, with one release holding the tender as read. The site publishes no rate limit, so the client sets its own: one request at a time, with a random wait between sources.eu_supply.request_min_gap and request_max_gap (2s to 10s). The source has the same 7-day backfill as Find a Tender's. Most of its tenders are also on Find a Tender, so a new one is stored Hidden and Skipped when another source's opportunity released within 30 days has a title at least 90% alike, and its buyer or description matches too (80% of the shorter one's significant words).
43 lines
1.4 KiB
HTML
43 lines
1.4 KiB
HTML
<!DOCTYPE html>
|
|
<html>
|
|
<body>
|
|
<div id="tenderInfoSection" class="ctm-section-box">
|
|
<div class="row-fluid">
|
|
<div class="span9 ctm-divider-right">
|
|
<div class="ctm-content-label">Detailed description:</div>
|
|
<p class="ctm-multi-line">This opportunity is for a framework agreement.
|
|
The Supplier(s) shall manage the full licence lifecycle (the 'Agreement').</p>
|
|
<div class="ctm-content-label">Type of contract:</div>
|
|
<p>Supplies</p>
|
|
<div class="ctm-content-label">Response deadline (UK time):</div>
|
|
<p>04/11/2026 12:00:00</p>
|
|
<div class="ctm-content-label">CPV codes:</div>
|
|
<p>
|
|
<span class="text-underline">48000000-8 Software package and information systems</span><br />
|
|
<span class="">72220000-3 Systems and technical consultancy services</span><br />
|
|
</p>
|
|
</div>
|
|
<div class="span3">
|
|
<div class="ctm-content-label">Buyer:</div>
|
|
<p>
|
|
<br />
|
|
Jisc <br />
|
|
4 Portwall Lane <br />
|
|
BS1 6NB <br />
|
|
Bristol <br />
|
|
United Kingdom
|
|
<br />
|
|
<a href="/ctm/Supplier/CompanyInformation/Index/87175" class="openPopup">
|
|
View profile
|
|
</a>
|
|
</p>
|
|
<div class="ctm-content-label">Contact:</div>
|
|
<p><br /><a href="https://www.jisc.ac.uk" target="_blank">https://www.jisc.ac.uk</a></p>
|
|
</div>
|
|
</div>
|
|
</div>
|
|
<div class="package-container"><div class="row-fluid">Lot 1</div></div>
|
|
<div class="package-container"><div class="row-fluid">Lot 2</div></div>
|
|
</body>
|
|
</html>
|