Files
tfm_ainventory/config/ai_prompt.md
Daniel Bedeleanu 70a08ae1e9 improve: add rotation bounds and error detection to AI prompt
- Cap normal rotation to -45 to +45 degrees (flags errors beyond)
- Add explicit warning about 60°+ being measurement error
- Clarify 'safe default' is 0 if uncertain
- Prevent Gemini from wild angle guesses (like 110°)
- Help AI self-correct measurement errors
2026-04-22 09:44:28 +03:00

6.7 KiB

Technical Inventory Hardware Extraction Protocol

Extract ALL relevant hardware items from the image with precise, standardized formatting.

Filtering Rules

  • INCLUDE: Physical hardware, modules, cables, servers, storage, transceivers
  • EXCLUDE: Generic mounting hardware (screws, brackets, rails), paper licenses, empty packaging
  • Multi-item labels: Treat each SKU/variant as a separate item (e.g., "5m cable" and "7m cable" = 2 items)

Item Field Format (CRITICAL)

[]

Component Rules:

  • <size_or_length>:

    • STORAGE CAPACITY - HUMAN READABLE: Convert to largest unit (TB/MB).
      • Examples: "1600GB" → "1.6TB", "256GB" → "256GB", "512MB" → "512MB"
      • Rule: If ≥1000GB, use TB. If ≥1000MB, use GB. Otherwise use MB.
    • CABLE/WIRE LENGTH: Meters only. Examples: "5m", "10m", "50m"
    • RAM DIMM: Capacity in GB. Examples: "128GB", "32GB", "8GB"
  • <part_number>: Part number ONLY if visible. If the item has an identifiable Part Number, search web for what item this is and extract needed informations or compare with what was already identified, and correct all fields. Omit serial numbers.

  • <type>: Asset class. One of: DDR3/DDR4/DDR5, SSD/HDD/NVMe, SATA/SAS, Patchcord/Fiber/Cable, SFP/Transceiver, DIMM, etc.

  • <vendor>: Manufacturer (HP, HPE, Dell, Samsung, Cisco, Hynix, Intel, Broadcom)

  • <connector>: Physical interface (RJ45, LC-LC, MPO, U.3, SATA, SAS, ST, SC). Omit if N/A.

Item Examples (WITH HUMAN-READABLE SIZES):

  • 1.6TB NVMe HPE U.3 P66093-002 (not 1600GB)
  • 256GB SSD Dell SATA SK-8765 (already human-readable)
  • 5m Patchcord LC-LC
  • 128GB DDR4 Hynix
  • 512MB Cache Samsung SATA (stays MB if under 1GB)

Size Conversion Examples:

  • 1600GB → 1.6TB
  • 2048GB → 2TB
  • 512GB → 512GB (under 1TB threshold)
  • 256MB → 256MB
  • 1024MB → 1GB

Restrictions:

  • No comments in parenthesis
  • No measurement units in Item field (e.g., "1.6TB" not "1.6TB Storage")
  • No secondary vendors
  • No diameter/mm in Item field
  • ONE vendor only (primary manufacturer)

Other Fields

  • Type: Repeat the asset class (DDR4, SSD, NVMe, Patchcord, etc.)
  • Description: Technical summary, max 5 words. Examples: "High-speed fiber optic", "Enterprise Gen4 storage"
  • Category: Memory, Storage, Network, Cabling, Compute, Optical, Transceiver
  • Connector: Interface type from Item field. Examples: "LC-LC", "RJ45", "U.3"
  • Size: HUMAN-READABLE capacity or length. Examples: "1.6TB", "256GB", "5m" (NOT "1600GB")
  • Color: Physical color if distinguishing
  • PartNr: Part number only (no serial numbers)
  • OCR: Robust matching key for OCR tolerance

OCR Field Rules (CRITICAL)

Generate a SHORT, clean matching key:

  • Format: UPPERCASE space-separated, NO special chars, NO duplicates
  • Include ONLY: Type + Size + Primary Vendor + Connector + Part Number
  • EXCLUDE: Serial numbers, secondary vendors, duplicate tokens, EMC/SK labels
  • USE HUMAN-READABLE SIZE: Use TB/GB from Item field, not original notation

OCR Format: TYPE SIZE VENDOR CONNECTOR PARTNUMBER

OCR Examples (WITH HUMAN-READABLE SIZES):

  • Item: 1.6TB NVMe HPE U.3 P66093-002 → OCR: NVME 1.6TB HPE U3 P66093002
  • Item: 5m Patchcord LC-LC → OCR: PATCHCORD 5M LC LC
  • Item: 256GB SSD Samsung SAS SK-8765 → OCR: SSD 256GB SAMSUNG SAS SK8765
  • Item: 128GB DDR4 Hynix → OCR: DDR4 128GB HYNIX

OCR Constraints:

  • NO duplicate part numbers
  • NO secondary vendor names
  • NO extraneous labels
  • Each token appears ONE time only
  • Remove hyphens/special chars for fuzzy matching
  • Use HUMAN-READABLE sizes (1.6TB not 1600GB)

Image Processing Guidance (NEW)

Analyze the image layout and return crop/rotation metadata to optimize photo storage:

Crop Bounds Analysis

  • Identify the PRIMARY ITEM in the image (main object, not background/clutter)
  • Return bounding box: {x, y, width, height} in pixel coordinates
  • Rules:
    • x, y: top-left corner of item (pixel offset from image top-left)
    • width, height: dimensions of item bounding box
    • Include minimal padding (10-15 pixels) around item edges
    • Ignore background clutter, other items, hands, reflections

Rotation Analysis (CRITICAL - PRECISE TEXT ANGLE MEASUREMENT)

IMPORTANT: Return SMALL angles (typically -45 to +45). Large angles (60°+) indicate measurement error.

Algorithm:

  1. Locate the PRIMARY text/label on the item (part number, manufacturer, specs)

  2. Imagine a perfectly horizontal line (0°)

  3. Measure how many degrees the text baseline is rotated FROM horizontal:

    • Count degrees counter-clockwise = POSITIVE value to return
    • Count degrees clockwise = NEGATIVE value to return
    • LIMIT: Most items need -45° to +45°. If you calculate ±60° or more, re-examine your measurement.
  4. Return exactly this value as rotation_degrees

    • SMALL adjustments: 0° to ±30° (most common)
    • LARGE adjustments: ±31° to ±45° (rare, carefully verify)
    • EXTREME values (±60°+): Likely error — recalculate or return 0

Measurement examples (measure the TEXT BASELINE angle only): - Text reads horizontally → 0 - Text tilted slightly left (counter-clockwise), ~15-25° → +15 to +25 (NOT higher) - Text tilted slightly right (clockwise), ~10-20° → -10 to -20 (NOT lower) - Text perfectly vertical pointing left → 90 (only if TRULY vertical) - Text perfectly vertical pointing right → -90 (only if TRULY vertical) - If uncertain or mixed angles → 0 (safe default)

Confidence Score

  • Return confidence: 0.0-1.0 indicating reliability of crop/rotation analysis
  • 0.9+ = High confidence (clear item, readable text)
  • 0.7-0.89 = Medium confidence (some ambiguity or text partially obscured)
  • <0.7 = Low confidence (cluttered image, unclear item boundaries)

Output Format (Extended)

{
  "items": [
    {
      "Item": "[size] type vendor connector partnumber",
      "Type": "type",
      "Description": "technical details (max 5 words)",
      "Category": "category",
      "Connector": "connector_type",
      "Size": "human_readable_size",
      "Color": "color",
      "PartNr": "part_number",
      "OCR": "TYPE SIZE VENDOR CONNECTOR PARTNUMBER",
      "image_processing": {
        "crop_bounds": {
          "x": 50,
          "y": 100,
          "width": 300,
          "height": 200
        },
        "rotation_degrees": 15,
        "confidence": 0.92
      }
    }
  ]
}

Return ONLY JSON. No markdown. No text.