Pretraining Graph Neural Networks for few-shot Analog Circuit Modeling
  and Design
  Being able to predict the performance of circuits without running expensive
simulations is a desired capability that can catalyze automated design. In this
paper, we present a supervised pretraining approach to learn circuit
representations that can be adapted to new circuit topologies or unseen
prediction tasks. We hypothesize that if we train a neural network (NN) that
can predict the output DC voltages of a wide range of circuit instances it will
be forced to learn generalizable knowledge about the role of each circuit
element and how they interact with each other. The dataset for this supervised
learning objective can be easily collected at scale since the required DC
simulation to get ground truth labels is relatively cheap. This representation
would then be helpful for few-shot generalization to unseen circuit metrics
that require more time consuming simulations for obtaining the ground-truth
labels. To cope with the variable topological structure of different circuits
we describe each circuit as a graph and use graph neural networks (GNNs) to
learn node embeddings. We show that pretraining GNNs on prediction of output
node voltages can encourage learning representations that can be adapted to new
unseen topologies or prediction of new circuit level properties with up to 10x
more sample efficiency compared to a randomly initialized model. We further
show that we can improve sample efficiency of prior SoTA model-based
optimization methods by 2x (almost as good as using an oracle model) via
fintuning pretrained GNNs as the feature extractor of the learned models.
