AdditiveNoiseStep¶
Chainable step that adds Gaussian noise to the gradients.
This can improve convergence and mitigate overfitting in some deep networks. Version 0.2.0
Ports/Properties¶
gradients¶
Gradients to be transformed.
- verbose name: Gradients
- default value: None
- port type: DataPort
- value type: object (can be None)
- data direction: INOUT
weights¶
Optional current weights.
- verbose name: Weights
- default value: None
- port type: DataPort
- value type: object (can be None)
- data direction: IN
state¶
Explicit state of the node.
- verbose name: State
- default value: None
- port type: DataPort
- value type: object (can be None)
- data direction: INOUT
eta¶
Initial variance for the Gaussian noise added to gradients.
- verbose name: Eta
- default value: 0.01
- port type: FloatPort
- value type: float (can be None)
gamma¶
A parameter controlling the annealing of noise over time, the variance decays according to (1+t)^-gamma.
- verbose name: Gamma
- default value: 0.55
- port type: FloatPort
- value type: float (can be None)
seed¶
A seed for the pseudo-random number generation.
- verbose name: Seed
- default value: 12345
- port type: IntPort
- value type: int (can be None)
set_breakpoint¶
Set a breakpoint on this node. If this is enabled, your debugger (if one is attached) will trigger a breakpoint.
- verbose name: Set Breakpoint (Debug Only)
- default value: False
- port type: BoolPort
- value type: bool (can be None)
metadata¶
User-definable meta-data associated with the node. Usually reserved for technical purposes.
- verbose name: Metadata
- default value: {}
- port type: DictPort
- value type: dict (can be None)