Serialization
Saving and loading SameDiff graphs in FlatBuffers format
SameDiff graphs — including their structure, variables, constants, and trained parameters — can be saved to and loaded from files using the FlatBuffers binary format. This enables model deployment, checkpointing during training, and sharing trained models.
Saving a SameDiff Graph
save()
Save the complete graph including all variables, constants, and parameter values:
import org.nd4j.autodiff.samediff.SameDiff;
import java.io.File;
// Save with updater state (for resuming training)
sd.save(new File("model.fb"), true);
// Save without updater state (smaller file, for inference only)
sd.save(new File("model.fb"), false);The second argument controls whether to include the updater state (momentum buffers, adaptive learning rate accumulators, etc.). Include it if you plan to resume training; omit it for inference-only deployment.
asFlatGraph()
Convert the graph to a FlatBuffers byte buffer in memory (useful for embedding in other formats or sending over the network):
import java.nio.ByteBuffer;
ByteBuffer buffer = sd.asFlatGraph(true); // true = include updater stateasFlatPrint()
Get a human-readable string representation of the graph (for debugging):
This prints the graph structure, variable names, shapes, and operation types.
Loading a SameDiff Graph
load()
Load a previously saved graph:
fromFlatGraph()
Load from a FlatBuffers byte buffer:
What Gets Saved
Graph structure (ops, connections)
Always
The computation graph topology
VARIABLE values (weights, biases)
Always
Trainable parameters
CONSTANT values
Always
Non-trainable stored values
PLACEHOLDER definitions
Always
Shape and type info (not values)
ARRAY definitions
Always
Shape and type info (not values — computed at runtime)
Updater state
Optional
Momentum/adaptive rate buffers. Only if saveUpdater=true
TrainingConfig
With updater
Optimizer settings
Training Checkpoints
Save periodic checkpoints during training for recovery:
Resume training from a checkpoint:
Interop with Model Import
SameDiff is also the target format for model import from other frameworks. When you import a TensorFlow or ONNX model, the result is a SameDiff graph:
This workflow (import once, save as FlatBuffers, load FlatBuffers for serving) avoids repeated parsing of the original model format.
File Format Details
SameDiff uses FlatBuffers as its serialization format:
Binary format: Compact, fast to serialize/deserialize
No schema evolution issues: Forward and backward compatible
Zero-copy reads: FlatBuffers can be read directly from the buffer without unpacking
Cross-platform: Same file works on any OS/architecture
Typical file sizes depend on model complexity:
Simple MLP (784→256→10): ~1-2 MB
ResNet-18: ~45 MB
Large transformer: 100+ MB
Best Practices
Save without updater state for deployment — reduces file size significantly (updater state can be 2-3x the model parameters for Adam)
Save with updater state for checkpoints — allows seamless training resumption
Convert imported models to FlatBuffers — much faster to load than parsing TF/ONNX format each time
Version your saved models — include epoch/date in filenames for traceability
Verify after loading — run a sample inference to confirm the loaded model produces expected results
Last updated
Was this helpful?