TVM
TVM Key features and brief samples.
Nd4j allows execution of models via javacpp's tvm bindings using nd4j's INDArray as a data structure. Leveraging the nd4j-tvm interop is fairly simple.
A TVM model can be loaded and executed as follows:
File f = new File ("path/to/your/model.pb");
INDArray x = Nd4j.scalar(1.0f).reshape(1,1);
TvmRunner tvmRunner = TvmRunner.builder()
.modelUri(f.getAbsolutePath())
.build();
Map<String,INDArray> inputs = new LinkedHashMap<>();
inputs.put("x",x);
Map<String, INDArray> exec = tvmRunner.exec(inputs);
INDArray z = exec.get("0");
This outputs a result with a map of output names to the ndarray result from tvm.
In maven, add the following dependency:
<dependency>
<groupId>org.nd4j</groupId>
<artifactId>nd4j-tvm</groupId>
<version>${nd4j.version}</version>
</dependency>
Note, this depends on javacpp's tvm bindings. This means tvm's native binaries are managed by javacpp. Javacpp will bundle all native binaries for all platforms by default unless you specify a platform. You can do this by specifying a -Dplatform=your-platform-of-choice. You may find more here in the javacpp docs.
Last modified 7mo ago