Untitled

avatar
unknown
plain_text
3 months ago
8.9 kB
5
Indexable
render@srv-d5l2hv0gjchc73bssra0-575cf746f6-78fvk:~/project/src/server$ ONNX_MODELS_PATH=/data/models/onnx npx ts-node --transpile-only scripts/backfill-email-classification.ts
ONNX_MODELS_PATH = /data/models/onnx
Resolved email model dir: /data/models/onnx/email_classifier
  model_quantized.onnx: EXISTS (143.6MB)
  tokenizer.json: EXISTS (3.4MB)
  label_mapping.json: EXISTS (0.0MB)
[2026-03-26T12:00:27.612Z] INFO  [OnnxClassifiers] [OnnxClassifiers] Models found at /data/models/onnx: email: OK (144MB), form: OK (144MB), site: OK (144MB)

Running test classification...
2026-03-26 12:00:27.660160104 [W:onnxruntime:onnxruntime-node, device_discovery.cc:211 DiscoverDevicesForPlatform] GPU device discovery failed: device_discovery.cc:91 ReadFileContents Failed to open file: "/sys/class/drm/card0/device/vendor"
[2026-03-26T12:00:28.930Z] INFO  [OnnxClassifiers] [OnnxClassifiers] Using JS WordPiece tokenizer (vocab size: 50368)
[2026-03-26T12:00:28.930Z] INFO  [OnnxClassifiers] [OnnxClassifiers] Loaded email_classifier (5 classes)
Test result: ROUTINE (confidence=0.9996, 286.77ms)
All scores: {"PLATFORM_NOTIFICATION":0.0004,"ROUTINE":0.9996,"SOCIAL_ENGINEERING":0,"VENDOR_BANK_CHANGE":0,"VENDOR_INVOICE":0}

Emails needing classification: 1150
  Progress: 50/1150 classified ({"ROUTINE":49,"PLATFORM_NOTIFICATION":1})
  Progress: 100/1150 classified ({"ROUTINE":99,"PLATFORM_NOTIFICATION":1})
  Progress: 150/1150 classified ({"ROUTINE":148,"PLATFORM_NOTIFICATION":2})
  Progress: 200/1150 classified ({"ROUTINE":197,"PLATFORM_NOTIFICATION":3})
  Progress: 250/1150 classified ({"ROUTINE":246,"PLATFORM_NOTIFICATION":4})
  Progress: 300/1150 classified ({"ROUTINE":295,"PLATFORM_NOTIFICATION":5})
  Progress: 350/1150 classified ({"ROUTINE":345,"PLATFORM_NOTIFICATION":5})
  Progress: 400/1150 classified ({"ROUTINE":395,"PLATFORM_NOTIFICATION":5})
  Progress: 450/1150 classified ({"ROUTINE":443,"PLATFORM_NOTIFICATION":7})
  Progress: 500/1150 classified ({"ROUTINE":491,"PLATFORM_NOTIFICATION":9})
  Progress: 550/1150 classified ({"ROUTINE":539,"PLATFORM_NOTIFICATION":10,"VENDOR_INVOICE":1})
  Progress: 600/1150 classified ({"ROUTINE":589,"PLATFORM_NOTIFICATION":10,"VENDOR_INVOICE":1})

=== Backfill Complete ===
Processed: 600
Classified: 600
Failed: 0
Distribution: { ROUTINE: 589, PLATFORM_NOTIFICATION: 10, VENDOR_INVOICE: 1 }
render@srv-d5l2hv0gjchc73bssra0-575cf746f6-78fvk:~/project/src/server$ ONNX_MODELS_PATH=/data/models/onnx npx ts-node --transpile-only scripts/backfill-email-classification.ts
ONNX_MODELS_PATH = /data/models/onnx
Resolved email model dir: /data/models/onnx/email_classifier
  model_quantized.onnx: EXISTS (143.6MB)
  tokenizer.json: EXISTS (3.4MB)
  label_mapping.json: EXISTS (0.0MB)
[2026-03-26T12:05:54.804Z] INFO  [OnnxClassifiers] [OnnxClassifiers] Models found at /data/models/onnx: email: OK (144MB), form: OK (144MB), site: OK (144MB)

Running test classification...
2026-03-26 12:05:54.826737744 [W:onnxruntime:onnxruntime-node, device_discovery.cc:211 DiscoverDevicesForPlatform] GPU device discovery failed: device_discovery.cc:91 ReadFileContents Failed to open file: "/sys/class/drm/card0/device/vendor"
[2026-03-26T12:05:56.322Z] INFO  [OnnxClassifiers] [OnnxClassifiers] Using JS WordPiece tokenizer (vocab size: 50368)
[2026-03-26T12:05:56.322Z] INFO  [OnnxClassifiers] [OnnxClassifiers] Loaded email_classifier (5 classes)
Test result: ROUTINE (confidence=0.9996, 286.66ms)
All scores: {"PLATFORM_NOTIFICATION":0.0004,"ROUTINE":0.9996,"SOCIAL_ENGINEERING":0,"VENDOR_BANK_CHANGE":0,"VENDOR_INVOICE":0}

Emails needing classification: 550
  Progress: 50/550 classified ({"ROUTINE":50})
  Progress: 100/550 classified ({"ROUTINE":98,"PLATFORM_NOTIFICATION":1,"VENDOR_BANK_CHANGE":1})
  Progress: 150/550 classified ({"ROUTINE":147,"PLATFORM_NOTIFICATION":2,"VENDOR_BANK_CHANGE":1})
  Progress: 200/550 classified ({"ROUTINE":197,"PLATFORM_NOTIFICATION":2,"VENDOR_BANK_CHANGE":1})
  Progress: 250/550 classified ({"ROUTINE":246,"PLATFORM_NOTIFICATION":3,"VENDOR_BANK_CHANGE":1})
  Progress: 300/550 classified ({"ROUTINE":296,"PLATFORM_NOTIFICATION":3,"VENDOR_BANK_CHANGE":1})

=== Backfill Complete ===
Processed: 300
Classified: 300
Failed: 0
Distribution: { ROUTINE: 296, PLATFORM_NOTIFICATION: 3, VENDOR_BANK_CHANGE: 1 }
render@srv-d5l2hv0gjchc73bssra0-575cf746f6-78fvk:~/project/src/server$ ONNX_MODELS_PATH=/data/models/onnx npx ts-node --transpile-only scripts/backfill-email-classification.ts
ONNX_MODELS_PATH = /data/models/onnx
Resolved email model dir: /data/models/onnx/email_classifier
  model_quantized.onnx: EXISTS (143.6MB)
  tokenizer.json: EXISTS (3.4MB)
  label_mapping.json: EXISTS (0.0MB)
[2026-03-26T12:09:04.406Z] INFO  [OnnxClassifiers] [OnnxClassifiers] Models found at /data/models/onnx: email: OK (144MB), form: OK (144MB), site: OK (144MB)

Running test classification...
2026-03-26 12:09:04.430599582 [W:onnxruntime:onnxruntime-node, device_discovery.cc:211 DiscoverDevicesForPlatform] GPU device discovery failed: device_discovery.cc:91 ReadFileContents Failed to open file: "/sys/class/drm/card0/device/vendor"
[2026-03-26T12:09:05.630Z] INFO  [OnnxClassifiers] [OnnxClassifiers] Using JS WordPiece tokenizer (vocab size: 50368)
[2026-03-26T12:09:05.631Z] INFO  [OnnxClassifiers] [OnnxClassifiers] Loaded email_classifier (5 classes)
Test result: ROUTINE (confidence=0.9996, 283.75ms)
All scores: {"PLATFORM_NOTIFICATION":0.0004,"ROUTINE":0.9996,"SOCIAL_ENGINEERING":0,"VENDOR_BANK_CHANGE":0,"VENDOR_INVOICE":0}

Emails needing classification: 250
  Progress: 50/250 classified ({"ROUTINE":49,"PLATFORM_NOTIFICATION":1})
  Progress: 100/250 classified ({"ROUTINE":97,"PLATFORM_NOTIFICATION":3})
  Progress: 150/250 classified ({"ROUTINE":146,"PLATFORM_NOTIFICATION":4})

=== Backfill Complete ===
Processed: 150
Classified: 150
Failed: 0
Distribution: { ROUTINE: 146, PLATFORM_NOTIFICATION: 4 }
render@srv-d5l2hv0gjchc73bssra0-575cf746f6-78fvk:~/project/src/server$ ONNX_MODELS_PATH=/data/models/onnx npx ts-node --transpile-only scripts/backfill-email-classification.ts
ONNX_MODELS_PATH = /data/models/onnx
Resolved email model dir: /data/models/onnx/email_classifier
  model_quantized.onnx: EXISTS (143.6MB)
  tokenizer.json: EXISTS (3.4MB)
  label_mapping.json: EXISTS (0.0MB)
[2026-03-26T12:10:35.518Z] INFO  [OnnxClassifiers] [OnnxClassifiers] Models found at /data/models/onnx: email: OK (144MB), form: OK (144MB), site: OK (144MB)

Running test classification...
2026-03-26 12:10:35.539409245 [W:onnxruntime:onnxruntime-node, device_discovery.cc:211 DiscoverDevicesForPlatform] GPU device discovery failed: device_discovery.cc:91 ReadFileContents Failed to open file: "/sys/class/drm/card0/device/vendor"
[2026-03-26T12:10:36.708Z] INFO  [OnnxClassifiers] [OnnxClassifiers] Using JS WordPiece tokenizer (vocab size: 50368)
[2026-03-26T12:10:36.708Z] INFO  [OnnxClassifiers] [OnnxClassifiers] Loaded email_classifier (5 classes)
Test result: ROUTINE (confidence=0.9996, 238.94ms)
All scores: {"PLATFORM_NOTIFICATION":0.0004,"ROUTINE":0.9996,"SOCIAL_ENGINEERING":0,"VENDOR_BANK_CHANGE":0,"VENDOR_INVOICE":0}

Emails needing classification: 100
  Progress: 50/100 classified ({"ROUTINE":49,"PLATFORM_NOTIFICATION":1})

=== Backfill Complete ===
Processed: 50
Classified: 50
Failed: 0
Distribution: { ROUTINE: 49, PLATFORM_NOTIFICATION: 1 }
render@srv-d5l2hv0gjchc73bssra0-575cf746f6-78fvk:~/project/src/server$ ONNX_MODELS_PATH=/data/models/onnx npx ts-node --transpile-only scripts/backfill-email-classification.ts
ONNX_MODELS_PATH = /data/models/onnx
Resolved email model dir: /data/models/onnx/email_classifier
  model_quantized.onnx: EXISTS (143.6MB)
  tokenizer.json: EXISTS (3.4MB)
  label_mapping.json: EXISTS (0.0MB)
[2026-03-26T12:11:00.901Z] INFO  [OnnxClassifiers] [OnnxClassifiers] Models found at /data/models/onnx: email: OK (144MB), form: OK (144MB), site: OK (144MB)

Running test classification...
2026-03-26 12:11:00.923259148 [W:onnxruntime:onnxruntime-node, device_discovery.cc:211 DiscoverDevicesForPlatform] GPU device discovery failed: device_discovery.cc:91 ReadFileContents Failed to open file: "/sys/class/drm/card0/device/vendor"
[2026-03-26T12:11:02.220Z] INFO  [OnnxClassifiers] [OnnxClassifiers] Using JS WordPiece tokenizer (vocab size: 50368)
[2026-03-26T12:11:02.220Z] INFO  [OnnxClassifiers] [OnnxClassifiers] Loaded email_classifier (5 classes)
Test result: ROUTINE (confidence=0.9996, 304.98ms)
All scores: {"PLATFORM_NOTIFICATION":0.0004,"ROUTINE":0.9996,"SOCIAL_ENGINEERING":0,"VENDOR_BANK_CHANGE":0,"VENDOR_INVOICE":0}

Emails needing classification: 50
  Progress: 50/50 classified ({"ROUTINE":49,"PLATFORM_NOTIFICATION":1})

=== Backfill Complete ===
Processed: 50
Classified: 50
Failed: 0
Distribution: { ROUTINE: 49, PLATFORM_NOTIFICATION: 1 }
render@srv-d5l2hv0gjchc73bssra0-575cf746f6-78fvk:~/project/src/server$
Editor is loading...
Leave a Comment