FFNet & PatternList & Categories: Learn...

You can choose this command after selecting one PatternList, one Categories and one FFNet.


Maximum number of epochs
the maximum number of times that the complete PatternList dataset will be presented to the neural net.
Tolerance of minimizer
when the difference in costs between two successive learning cycles is smaller than this value, the minimization process will be stopped.

Cost function

  costs = ∑allPatternsallOutputs (ok - dk)2, where
      ok : actual output of unit k
      dk : desired output of unit k
  costs = - ∑allPatternsallOutputs (dk · ln ok + (1-dk) · ln (1-ok))


The minimization procedure is a variant of conjugate gradient minimization, see for example Press et al. (1992), chapter 10, or Nocedal & Wright (1999), chapter 5.

Links to this page

© djmw, May 11, 2004