Class: Retailer::Extractors::BuildCom
- Inherits:
-
Base
- Object
- Base
- Retailer::Extractors::BuildCom
- Defined in:
- app/services/retailer/extractors/build_com.rb
Overview
Build.com (Ferguson Home) data extractor.
Uses JSON-LD structured data and specific selectors.
Supports URL discovery from search results.
Search URL format: https://www.fergusonhome.com/search?term=sku
Product URL format: https://www.fergusonhome.com/brand-product-slug/sid?uid=uid
Class Method Summary collapse
-
.build_payload(url:) ⇒ Hash
Build Oxylabs payload for Build.com product scraping Uses 'universal' source with JS rendering.
Instance Method Summary collapse
Class Method Details
.build_payload(url:) ⇒ Hash
Build Oxylabs payload for Build.com product scraping
Uses 'universal' source with JS rendering.
16 17 18 19 20 21 22 |
# File 'app/services/retailer/extractors/build_com.rb', line 16 def self.build_payload(url:) { source: 'universal', url: url, render: 'html' } end |
Instance Method Details
#catalog_base_url ⇒ Object (protected)
42 43 44 |
# File 'app/services/retailer/extractors/build_com.rb', line 42 def catalog_base_url 'https://www.fergusonhome.com' end |
#extract(check, content) ⇒ Object
24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 |
# File 'app/services/retailer/extractors/build_com.rb', line 24 def extract(check, content) return unless valid_html?(content) check.scraper_source = source_name check.currency = 'USD' doc = parse_html(content) # Determine if this is a search results page or product page if search_results_page?(content) extract_from_search_page(check, doc) else extract_from_product_page(check, doc, content) end end |