Housekeeping ahead of the Inc 1-4 coverage work

- inventory.py --methods: report the instance methods the app calls per class,
  plus chained calls that constrain a return type. --check says which classes
  to bind; this says what to bind on them, which is what writing ~38 module
  TUs needs.
- Drop StlAPI from the inventory: StlAPI_Writer has no app call site (the only
  use was a test fixture, now on the app's own STL writer). 138 symbols / 47
  modules.
- adding-symbols.md: scope the executing-constructor ban to the BRepAlgoAPI
  booleans, which are the only classes with a deferred Set*/Build form —
  BRepMesh_IncrementalMesh, GeomAPI_*, BRepCheck_Analyzer and friends compute
  in their constructor by design and bind as stock. Replace the per-increment
  app-test guidance: backend/tests/conftest.py imports n3xd.main, so no app
  test can collect until the last module is bound. Increments gate on
  stock-recorded fixtures here; the app suite is the Inc 4 gate.
- parity_venv.sh: run the ocp suite in the swapped venv (it imports only
  OCP/n3xd_ocp, so it works throughout).
- Fix a stale macro name in occt_handle.h (ocp_new, not OCP_TRANSIENT_NEW) and
  drop the unused ocp_transient_class helper.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01DfriM8XUkn7uYf5Dwe2xo6
This commit is contained in:
2026-08-10 19:23:27 +02:00
parent bfeb089542
commit 091a2ad0cf
6 changed files with 134 additions and 25 deletions

View File

@@ -7,14 +7,21 @@ Read [design.md](design.md) first if you are touching the machinery instead.
```bash
python tools/inventory.py --emit # re-scan the app for OCP usage
python tools/inventory.py --check # what the installed wheel lacks, by module
python tools/inventory.py --check # what the wheel lacks, by module
python tools/inventory.py --methods --only BRepAdaptor # what to bind on each class
```
`--check` groups gaps by module, which is how increments are scoped. Note it
only sees symbols reached through an import (`TopExp.MapShapes_s`), not methods
called on instances (`shape.IsSame(...)`) — a green `--check` is necessary, not
sufficient. Running the app's own tests in the parity venv is what catches the
rest, loudly, as an `AttributeError`.
`--check` groups gaps by module, which is how increments are scoped. It only
sees symbols reached through an import (`TopExp.MapShapes_s`), so it answers
*which* classes to bind but not *what* to bind on them.
`--methods` answers the second question: it resolves variables assigned
straight from a constructor and reports the methods called on them, plus
chained calls as `Klass.Outer() -> Inner` (those constrain `Outer`'s **return**
type — `adaptor.Cylinder().Radius()` is a requirement on `gp_Cylinder`). It is
a heuristic — it does not follow arguments, returns or attributes, and a local
reassigned from something else shows up as noise — so read it as a starting
surface, not a specification.
## 2. Write the module
@@ -50,8 +57,13 @@ only in that a base class must precede its derived classes.
`nb::class_` declaration and bind constructors with `ocp_new<T, Args...>()`.
Never `nb::init<>` — see design.md.
- **Long kernel call** → `OCP_NOGIL`, but only if it cannot re-enter Python.
- **Executing constructor** → do not bind it. Bind the default constructor plus
the `SetX`/`Build` sequence.
- **Executing constructor** → banned only where a deferred `SetX`/`Build` API
exists and the constructor duplicates `Build()`: the `BRepAlgoAPI_*` booleans
and splitter. Bind their default constructor plus the `SetX`/`Build`
sequence. Classes that only compute in their constructor and have no deferred
form — `BRepMesh_IncrementalMesh`, `BRepCheck_Analyzer`, `GeomAPI_*`,
`BRepClass3d_SolidClassifier`, `BRepExtrema_DistShapeShape`, `GCPnts_*`,
`BRepBuilderAPI_Transform` — bind exactly as stock does.
- **Enum** → `nb::is_arithmetic()` and `.export_values()`.
- **`Message_ProgressRange` parameters** → omit them. The app never passes one
(no `OCP.Message` import anywhere), and leaving them out keeps signatures
@@ -82,11 +94,18 @@ make publish
tools/parity_venv.sh && python tools/inventory.py --check
```
Then run the slice of the app's suite the increment claims — Inc 1 is gated on
`backend/tests/test_geom_memo.py`, Inc 2 on the tessellation tests plus
`pytest -m perf`, Inc 4 on `test_cad_pool.py` and `test_derive.py`, and the
cutover on the full suite plus `backend/tools/rebuild_sweep.py --diff` over the
project store.
**The app's own tests cannot gate an individual increment.** `backend/tests/
conftest.py` imports `n3xd.main`, which pulls in the whole app and therefore the
whole OCP surface, so every backend test fails at collection until the last
module is bound. Increments are gated here instead: `tools/gen_fixtures.py`
records reference values from the *stock* wheel (counts, `Modified`/`Generated`/
`IsDeleted` history maps, measured floats) into `tests/data/manifest.json`, and
`tests/test_inc<N>_*.py` reproduces the same constructions under our wheel.
Counts and history maps must match exactly; floats compare at rel 1e-9.
The app's full suite is the **Inc 4** gate, run in the parity venv, alongside
`pytest -m perf` and `backend/tools/rebuild_sweep.py --diff` over the project
store.
## Adding to `n3xd_ocp` instead

View File

@@ -212,9 +212,6 @@
"StdPrs_BRepFont": [],
"StdPrs_BRepTextBuilder": []
},
"StlAPI": {
"StlAPI_Writer": []
},
"TColStd": {
"TColStd_Array1OfInteger": [],
"TColStd_Array1OfReal": [],

View File

@@ -22,7 +22,7 @@
That last sentence is only true if every wrapped transient was heap
allocated and is handle-owned. See occt_transient.h — transient
constructors are bound through OCP_TRANSIENT_NEW, never nb::init<>, so
constructors are bound through ocp_new<T, Args...>(), never nb::init<>, so
Python never owns transient storage. from_python re-checks the invariant
rather than trusting it, because the failure mode is a double free.
*/

View File

@@ -24,13 +24,6 @@
namespace nb = nanobind;
/// Declare a bound transient class. Bind its constructors with ocp_new<T,
/// Args...>() — nb::init<> on such a class is a bug (see above).
template <typename T, typename... Bases>
nb::class_<T, Bases...> ocp_transient_class(nb::handle scope, const char *name) {
return nb::class_<T, Bases...>(scope, name);
}
/// Heap-allocating constructor for a transient class:
///
/// cls.def(ocp_new<Poly_Triangulation, int, int, bool>(),

View File

@@ -80,6 +80,91 @@ def scan(app_root: pathlib.Path) -> dict:
}
def methods(app_root: pathlib.Path, only: str | None) -> int:
"""Report the *instance* methods the app calls on each OCP class.
`scan` only sees names reached through an import, which is enough to know
*which* classes to bind but not *what* to bind on them. This fills that
gap well enough to write a module in one pass instead of discovering the
surface one AttributeError at a time: variables assigned straight from a
constructor carry their class through the file, so `a = BRepAdaptor_Surface(f)`
followed by `a.GetType()` is resolved.
Chained calls are reported separately as `Klass.Outer() -> Inner`, because
what they constrain is the *return* type — `adaptor.Cylinder().Radius()`
says gp_Cylinder needs `Radius`, not that BRepAdaptor_Surface does.
Heuristic by construction: it does not follow arguments, returns or
attributes, so treat a quiet class as "look again", not "nothing needed".
"""
direct: dict[str, set[str]] = collections.defaultdict(set)
chained: dict[str, set[str]] = collections.defaultdict(set)
for path in sorted(app_root.rglob("*.py")):
if "__pycache__" in path.parts:
continue
try:
tree = ast.parse(path.read_text(encoding="utf-8"))
except (SyntaxError, UnicodeDecodeError):
continue
classes = {
alias.asname or alias.name: alias.name
for node in ast.walk(tree)
if isinstance(node, ast.ImportFrom)
and node.module
and (node.module == "OCP" or node.module.startswith("OCP."))
for alias in node.names
}
if not classes:
continue
# local variable -> OCP class, from `v = Klass(...)`
env: dict[str, str] = {}
for node in ast.walk(tree):
if isinstance(node, ast.Assign) and isinstance(node.value, ast.Call):
fn = node.value.func
cls = classes.get(getattr(fn, "id", ""))
if cls:
for tgt in node.targets:
if isinstance(tgt, ast.Name):
env[tgt.id] = cls
def owner(node: ast.expr) -> str | None:
"""The OCP class an expression evaluates to, when knowable."""
if isinstance(node, ast.Name):
return env.get(node.id)
if isinstance(node, ast.Call):
return classes.get(getattr(node.func, "id", ""))
return None
for node in ast.walk(tree):
if not isinstance(node, ast.Attribute):
continue
cls = owner(node.value)
if cls:
direct[cls].add(node.attr)
continue
# <known>.Outer().Inner — constrains Outer's return type
inner = node.value
if isinstance(inner, ast.Call) and isinstance(inner.func, ast.Attribute):
cls = owner(inner.func.value)
if cls:
chained[f"{cls}.{inner.func.attr}()"].add(node.attr)
def dump(title: str, data: dict[str, set[str]]) -> None:
keys = [k for k in sorted(data) if only is None or only in k]
if not keys:
return
print(f"\n{title}")
for key in keys:
print(f" {key}: {', '.join(sorted(data[key]))}")
dump("instance methods, by class:", direct)
dump("chained calls (constrain the return type):", chained)
return 0
def emit(app_root: pathlib.Path, out: pathlib.Path) -> int:
data = scan(app_root)
out.write_text(json.dumps(data, indent=2) + "\n")
@@ -130,10 +215,18 @@ def main() -> int:
ap.add_argument("--emit", action="store_true", help="rewrite the inventory")
ap.add_argument("--check", action="store_true",
help="compare the installed OCP against the inventory")
ap.add_argument("--methods", action="store_true",
help="report the instance methods the app calls per class")
ap.add_argument("--only", help="with --methods: substring filter on the class")
ap.add_argument("--app", type=pathlib.Path, default=DEFAULT_APP)
ap.add_argument("--inventory", type=pathlib.Path, default=DEFAULT_INVENTORY)
args = ap.parse_args()
if args.methods:
if not args.app.is_dir():
print(f"app sources not found: {args.app}", file=sys.stderr)
return 2
return methods(args.app, args.only)
if args.emit:
if not args.app.is_dir():
print(f"app sources not found: {args.app}", file=sys.stderr)

View File

@@ -51,3 +51,10 @@ print('modules:', len(OCP._OCP.__all_modules__))
echo "--- coverage against the app's symbol inventory ---"
uv run python "$HERE/inventory.py" --check || \
echo "(incomplete coverage is expected until the increments land)"
# The binding's own suite, run from the swapped venv: this is what exercises the
# published artifact inside the app's exact dependency set. It imports only
# OCP/n3xd_ocp, so it works long before the app's own tests can collect (their
# conftest imports n3xd.main, i.e. the whole OCP surface).
echo "--- ocp suite under the swapped venv ---"
uv run pytest "$OCP_REPO/tests" -q