Postagem em destaque

Antologia: Miríade, Distopia, Utopia (2004-2024) -

     Antologia : Miríade, Distopia, Utopia  (2004-2024); @vanres1974; #antologia;  {11dez24 qua 20:40-20:50}      Anthology: Myriad, Dystopi...

Prof. Dr. Vander Resende, Doutorado em Lit Bras, pela UFMG; Mestre em Teorias Lit e Crít Cul, UFSJ

quinta-feira, 2 de abril de 2020

How deep learning works?


020420  02mar2020 


if a deep neural network is trained to
     identify objects in photos,
         it will employ different neurons to recognize a photo of a cat than it will to recognize a school bus.

"You don't need to train all the neurons on every case," Medini said.
Deep learning networks were inspired by biology, and their central feature, artificial neurons, are small pieces of computer code that can learn to perform a specific task.

A deep learning network can contain
     millions or even billions of 
     and working together they can
         learn to make
             human-level,
             expert decisions
                 simply by studying large amounts of data.

For example, if a deep neural network is trained to
     identify objects in photos,
         it will employ different neurons to recognize a photo of a cat than it will to recognize a school bus.

"You don't need to train all the neurons on every case," Medini said.
"We thought, 'If we only want to pick the neurons that are relevant, then it's a search problem.'
So, algorithmically, the idea was to use locality-sensitive hashing to get away from matrix multiplication."
Hashing is a data-indexing method invented for internet search in the 1990s. It uses numerical methods to encode large amounts of information, like entire webpages or chapters of a book, as a string of digits called a hash. Hash tables are lists of hashes that can be searched very quickly.
...
Shrivastava said SLIDE hasn't yet come close to reaching its potential.
"We've just scratched the surface," he said. "There's a lot we can still do to optimize. We have not used vectorization, for example, or built-in accelerators in the CPU, like Intel Deep Learning Boost. There are a lot of other tricks we could still use to make this even faster."
Shrivastava said SLIDE is important because it shows
there are other ways to implement .

Nenhum comentário:

Postar um comentário