Upload 25 files

iteration_2/README.md

@@ -0,0 +1,60 @@
+# StyleTTS2 → CoreML iteration_2
+
+Production-ready fp32 mlpackages adopting Trials 4 + 6 + 8b from
+`coreml/fusions.md`.
+
+## Pipeline (8 stages, 8 dispatches)
+
+```
+text_encoder       → CPU_ONLY      fp32   21 MB
+bert               → ALL           fp32   23 MB
+ref_encoder        → CPU_AND_GPU   fp32  106 MB
+fused_diffusion_sampler  → ALL    fp32   94 MB   ← Trial 4 (replaces diffusion_unet × 8)
+duration_predictor → CPU_ONLY      fp32   30 MB
+fused_f0n_har_source     → CPU_ONLY  fp32  32 MB ← Trial 6 (replaces f0n_predictor + har_source)
+decoder_pre        → CPU_AND_NE    fp32  128 MB
+decoder_upsample   → CPU_ONLY      fp32   79 MB
+```
+
+Total: **514 MB**, 8 mlpackages, 8 dispatches per utterance.
+
+## Performance
+
+Warm latency on M-series Mac, single-process, no other GPU/ANE workloads:
+
+* Pipeline warm: **~480–565 ms** (down from ~1030 ms baseline)
+* Stage count: 9 → 8 (Trials 4 + 6)
+* Dispatches per utterance: 16 → 8 (−50%)
+
+See `coreml/fusions.md` for full trial history, latency tables, parity
+chains, and per-stage placement sweep results.
+
+## Adopted trials
+
+| Trial | Change                                               | Save |
+|-------|------------------------------------------------------|------|
+| 4     | fused 5-step ADPM2 sampler (8 dispatches → 1)        | −437 ms warm |
+| 6     | fused f0n_predictor + har_source                     | −42 ms warm |
+| 8b    | bert→ALL, ref_encoder→CPU_AND_GPU, sampler→ALL       | small but stable |
+
+## Skipped / dropped
+
+| Trial | Outcome                                              |
+|-------|------------------------------------------------------|
+| 5     | har + decoder_upsample fuse — partition tax (+290 ms) |
+| 7     | ref_encoder + sampler fuse — partition tax (200 MB graph) |
+| 8a    | aggressive `decoder_upsample → ALL` — bimodal 322–759 ms |
+| 9     | `_hifigan_shift` fold — sub-1 ms saving, dominated by Trial 8 |
+
+## Usage
+
+Drop `packages/` into `models/tts/styletts2/coreml/` (or symlink) and
+run `python -m coreml.inference` from the styletts2 root. The
+`_STAGE_COMPUTE` and `_STAGE_PRECISION` manifests in
+`coreml/inference.py` are wired to load these by default.
+
+To compare against the legacy 9-package path:
+
+```bash
+python -m coreml.inference --no-fused
+```

iteration_2/packages/bert.mlpackage/Data/com.apple.CoreML/model.mlmodel

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8012da86238950009773b88ece84d6de35ba9b5c70fc6168aba3a1eb7cc8064b
+size 75521

iteration_2/packages/bert.mlpackage/Data/com.apple.CoreML/weights/weight.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d0d1ea7dabcc541d818a55e746da625e22bc5937b6fb20ee7a838627145e92ef
+size 24179328

iteration_2/packages/bert.mlpackage/Manifest.json

@@ -0,0 +1,18 @@
+{
+    "fileFormatVersion": "1.0.0",
+    "itemInfoEntries": {
+        "1BC2E76C-B9B2-4C7B-AED4-1E889E8F7FBE": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Weights",
+            "name": "weights",
+            "path": "com.apple.CoreML/weights"
+        },
+        "C180CF2C-D86C-42D0-AD5E-47F193744BC3": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Specification",
+            "name": "model.mlmodel",
+            "path": "com.apple.CoreML/model.mlmodel"
+        }
+    },
+    "rootModelIdentifier": "C180CF2C-D86C-42D0-AD5E-47F193744BC3"
+}

iteration_2/packages/decoder_pre.mlpackage/Data/com.apple.CoreML/model.mlmodel

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:950ae5f552e2d1238b36c3da24a1c63a2983a3ef2969e1a6e42ef2c21fabbb5b
+size 49028

iteration_2/packages/decoder_pre.mlpackage/Data/com.apple.CoreML/weights/weight.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0ae8235d8dda1e118c01137ee51b8aef02d6e0533831fea5c2bec6177d9fa3f9
+size 134378304

iteration_2/packages/decoder_pre.mlpackage/Manifest.json

@@ -0,0 +1,18 @@
+{
+    "fileFormatVersion": "1.0.0",
+    "itemInfoEntries": {
+        "2C253E60-4805-4B39-9657-E2C62926792B": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Weights",
+            "name": "weights",
+            "path": "com.apple.CoreML/weights"
+        },
+        "9CE7F5C2-332A-49A7-B10C-2522C7E06365": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Specification",
+            "name": "model.mlmodel",
+            "path": "com.apple.CoreML/model.mlmodel"
+        }
+    },
+    "rootModelIdentifier": "9CE7F5C2-332A-49A7-B10C-2522C7E06365"
+}

iteration_2/packages/decoder_upsample.mlpackage/Data/com.apple.CoreML/model.mlmodel

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cef66932900f7c2bd6f15405523542c06f612bb035fd4d41a6ac9e26c6e7b0d3
+size 425250

iteration_2/packages/decoder_upsample.mlpackage/Data/com.apple.CoreML/weights/weight.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:625ec116b48cba8e9999fcd45d756327d9726dff343331c29c279137d27193d2
+size 82761984

iteration_2/packages/decoder_upsample.mlpackage/Manifest.json

@@ -0,0 +1,18 @@
+{
+    "fileFormatVersion": "1.0.0",
+    "itemInfoEntries": {
+        "24CCEF67-C2F2-4AF9-B311-8CDC60B5FBBB": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Specification",
+            "name": "model.mlmodel",
+            "path": "com.apple.CoreML/model.mlmodel"
+        },
+        "29AFBB19-CEF9-48B5-9A99-B3B2152401DA": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Weights",
+            "name": "weights",
+            "path": "com.apple.CoreML/weights"
+        }
+    },
+    "rootModelIdentifier": "24CCEF67-C2F2-4AF9-B311-8CDC60B5FBBB"
+}

iteration_2/packages/duration_predictor.mlpackage/Data/com.apple.CoreML/model.mlmodel

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:13b19f796a2a8b7a7a9eb7be43c6de2d9b6030339c496b5d11ab1ee4f243f426
+size 25605

iteration_2/packages/duration_predictor.mlpackage/Data/com.apple.CoreML/weights/weight.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6ce5a0e45ed5d42bbb893191d2e3c27e334d41f30183c5cca87cbf1fc7d62b86
+size 31084928

iteration_2/packages/duration_predictor.mlpackage/Manifest.json

@@ -0,0 +1,18 @@
+{
+    "fileFormatVersion": "1.0.0",
+    "itemInfoEntries": {
+        "BDD110CC-1B78-45C1-A80C-1B0B4B2B2CE2": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Specification",
+            "name": "model.mlmodel",
+            "path": "com.apple.CoreML/model.mlmodel"
+        },
+        "F5A8FF41-763F-4328-ABB7-AF96AC9711F9": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Weights",
+            "name": "weights",
+            "path": "com.apple.CoreML/weights"
+        }
+    },
+    "rootModelIdentifier": "BDD110CC-1B78-45C1-A80C-1B0B4B2B2CE2"
+}

iteration_2/packages/fused_diffusion_sampler.mlpackage/Data/com.apple.CoreML/model.mlmodel

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e05e33d4729be4a613135117b85a7aff75116fee83d92621ccf16f252ba9553b
+size 271397

iteration_2/packages/fused_diffusion_sampler.mlpackage/Data/com.apple.CoreML/weights/weight.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5b786a3779f4c7c4572f5bb16f48756a0ae8988f3b53145307f7afbf08822392
+size 98720192

iteration_2/packages/fused_diffusion_sampler.mlpackage/Manifest.json

@@ -0,0 +1,18 @@
+{
+    "fileFormatVersion": "1.0.0",
+    "itemInfoEntries": {
+        "70286131-23BE-4491-8EDF-C1D6B030B687": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Weights",
+            "name": "weights",
+            "path": "com.apple.CoreML/weights"
+        },
+        "C9EF35A4-A334-4775-85FB-FCE928373822": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Specification",
+            "name": "model.mlmodel",
+            "path": "com.apple.CoreML/model.mlmodel"
+        }
+    },
+    "rootModelIdentifier": "C9EF35A4-A334-4775-85FB-FCE928373822"
+}

iteration_2/packages/fused_f0n_har_source.mlpackage/Data/com.apple.CoreML/model.mlmodel

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c98d56382c336dbea5a864e594022c11ced07372687dc66e56c7c91795e45c63
+size 61645

iteration_2/packages/fused_f0n_har_source.mlpackage/Data/com.apple.CoreML/weights/weight.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ce01b0523d8e925108b5f9ba113d5ff1721bb3e5e25f3eb6d8a2dfaa56876c59
+size 33640448

iteration_2/packages/fused_f0n_har_source.mlpackage/Manifest.json

@@ -0,0 +1,18 @@
+{
+    "fileFormatVersion": "1.0.0",
+    "itemInfoEntries": {
+        "696D6238-15F9-4A4A-AB5B-3957A847EB37": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Weights",
+            "name": "weights",
+            "path": "com.apple.CoreML/weights"
+        },
+        "8111F480-F3EF-48DE-91B8-5309A11BF779": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Specification",
+            "name": "model.mlmodel",
+            "path": "com.apple.CoreML/model.mlmodel"
+        }
+    },
+    "rootModelIdentifier": "8111F480-F3EF-48DE-91B8-5309A11BF779"
+}

iteration_2/packages/ref_encoder.mlpackage/Data/com.apple.CoreML/model.mlmodel

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c5ca9ec42449e2ffe1c8558f569c78bc1644b73dc91fa1b86390b71c54156cd2
+size 63752

iteration_2/packages/ref_encoder.mlpackage/Data/com.apple.CoreML/weights/weight.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:73357e91e4dccfe3159f735e9cca857cb0ebd52d0699fb6e5c87abd08ff56ee3
+size 110767808

iteration_2/packages/ref_encoder.mlpackage/Manifest.json

@@ -0,0 +1,18 @@
+{
+    "fileFormatVersion": "1.0.0",
+    "itemInfoEntries": {
+        "01330047-9152-4BED-8B50-2EC2B6B08F4D": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Weights",
+            "name": "weights",
+            "path": "com.apple.CoreML/weights"
+        },
+        "1501890B-8915-442A-934F-918E83B55691": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Specification",
+            "name": "model.mlmodel",
+            "path": "com.apple.CoreML/model.mlmodel"
+        }
+    },
+    "rootModelIdentifier": "1501890B-8915-442A-934F-918E83B55691"
+}

iteration_2/packages/text_encoder.mlpackage/Data/com.apple.CoreML/model.mlmodel

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:adec64010c7b89aabbce6561eac0d4ffb4fe226025f5475c24ab9b0cee800ff5
+size 14083

iteration_2/packages/text_encoder.mlpackage/Data/com.apple.CoreML/weights/weight.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7a59f5a30389f40e82f0bb8b44d025f8fcc8914462470db6c6d5d7a83e65eb3c
+size 22414656

iteration_2/packages/text_encoder.mlpackage/Manifest.json

@@ -0,0 +1,18 @@
+{
+    "fileFormatVersion": "1.0.0",
+    "itemInfoEntries": {
+        "68619DB6-4DCD-4F09-A236-AEBEF170ADA8": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Weights",
+            "name": "weights",
+            "path": "com.apple.CoreML/weights"
+        },
+        "F55399A3-FE64-43B0-A99C-197E1861DC1D": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Specification",
+            "name": "model.mlmodel",
+            "path": "com.apple.CoreML/model.mlmodel"
+        }
+    },
+    "rootModelIdentifier": "F55399A3-FE64-43B0-A99C-197E1861DC1D"
+}