Class: Retailer::Extractors::CanadianTire
- Inherits:
-
Base
- Object
- Base
- Retailer::Extractors::CanadianTire
- Defined in:
- app/services/retailer/extractors/canadian_tire.rb
Overview
Canadian Tire data extractor.
Uses JSON-LD structured data and specific selectors.
Supports URL discovery from search results.
URL format: https://www.canadiantire.ca/en/pdp/product-slug-product-idp.html
Constant Summary collapse
- RENDER_REQUIRED =
Canadian Tire PDP loads pricing client-side. Keep on.
true
Class Method Summary collapse
-
.build_payload(url:) ⇒ Hash
Build Oxylabs payload for Canadian Tire product scraping Uses 'universal' source with JS rendering.
Instance Method Summary collapse
Class Method Details
.build_payload(url:) ⇒ Hash
Build Oxylabs payload for Canadian Tire product scraping
Uses 'universal' source with JS rendering.
18 19 20 21 22 23 24 25 26 27 |
# File 'app/services/retailer/extractors/canadian_tire.rb', line 18 def self.build_payload(url:) { source: 'universal', url: url, render: render_value, context: [ { key: 'follow_redirects', value: true } ] }.compact end |
Instance Method Details
#catalog_base_url ⇒ Object (protected)
47 48 49 |
# File 'app/services/retailer/extractors/canadian_tire.rb', line 47 def catalog_base_url 'https://www.canadiantire.ca' end |
#extract(check, content) ⇒ Object
29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 |
# File 'app/services/retailer/extractors/canadian_tire.rb', line 29 def extract(check, content) return unless valid_html?(content) check.scraper_source = source_name check.currency = 'CAD' doc = parse_html(content) # Determine if this is a search results page or product page if search_results_page?(content) extract_from_search_page(check, doc) else extract_from_product_page(check, doc, content) end end |