Artificial neural network

**artificial neural network**
	computational model used in machine learning, based on connected, hierarchical functions Vue simplifiée d'un réseau artificiel de neurones
	Upload media
	Wikipedia Wikibooks Wikiversity
Spoken text audio	Englishⓘ
Pronunciation audio	Frenchⓘ
Instance of	type of statistical model;
Subclass of	neural network; discriminative model;
Facet of	artificial intelligence; machine learning;
Has part	neuron layer; loss function; optimizer; artificial neuron; neural processing unit;
Authority file
	Q192776; GND ID: 4226127-2; Library of Congress Authorities ID: sh90001937; NDL Authority ID: 01165604; NL CR AUT ID: ph115443; BabelNet ID: 00057388n; J9U entity ID: 987007551192405171
	Reasonator; Scholia; Wikidocumentaries; KML file; Search depicted;

<nowiki>red neuronal artificial; Neuronowy nec; Gervitauganet; Rangkaian neural buatan; изкуствена невронна мрежа; Yapay sinir ağları; اصطناعی عصبی جالکار; Tambajotra nerônina; artificiellt neuronnät; штучна нейронна мережа; 人工神經網絡; Artificala neuronala reto; 인공 신경망; artefarita neŭra reto; umělá neuronová síť; Vještačke neuronske mreže; কৃত্রিম নিউরাল নেটওয়ার্ক; réseau de neurones artificiels; umjetna neuronska mreža; mạng thần kinh nhân tạo; mākslīgais neironu tīkls; вештачка неурална мрежа; rede neural artificial; 人工神经网络; kunstig nevralt nettverk; nevralt nettverk; Süni Neyron Şəbəkələr; تۆڕی دەماریی دەستکرد; artificial neural network; شبكة عصبونية اصطناعية; အာရုံကြောပုံတူကွန်ရက်; 人工神經網絡; mesterséges neurális hálózat; neurona-sare artifizial; rede neural artificial; искусственная нейронная сеть; Kapchisqa ankucha llika; künstliches neuronales Netz; líonra néarach; شبکه عصبی مصنوعی; 人工神經網絡; kunstigt neuralt netværk; ხელოვნური ნეირონული ქსელი; ニューラルネットワーク; Rete neural artificial; רשת עצבית מלאכותית; Artificiale neuronum rete; कृत्रिम तंत्रिका नेटवर्क; కృత్రిమ నాడీ జీవ కణజాల వల; neuroverkko; Արուեստական Ջղաբջիջային Ցանց; โครงข่ายประสาทเทียม; செயற்கை நரம்பணுப் பிணையம்; rete neurale artificiale; 人工神经网络; ريزو د النورونات الصطيناعية; Jîn-kang sîn-keng bāng-lō͘; tehisnärvivõrk; вештачка невронска мрежа; Юрилле нейронла тетел; 人工神經網絡; Արհեստական նեյրոնային ցանց; 人工神經網路; штучная нэўронная сетка; rede neural artificial; Sunʼiy neyron tarmoqlari; Umelá neurónová sieť; ଆର୍ଟିଫିସିଆଲ ନ୍ୟୁରାଲ ନେଟୱର୍କ; dirbtinis neuroninis tinklas; umetna nevronska mreža; xarxa neuronal artificial; kunstmatig neuraal netwerk; rețea neuronală artificială; Jaringan saraf tiruan; sieć neuronowa; കൃത്രിമ നാഡീവ്യൂഹം; Umjetna neuronska mreža; 人工神经网络; нейросеть; ræ neurale artifiçiale; 人工神经网络; rede neural artificial; neuraalviermi; τεχνητό νευρωνικό δίκτυο; သၞောတ်အာရီုကောန်ကၞေင်; လူသားတို့၏ ဦးနှောက်တည်ဆောက်ပုံနှင့် ဇီဝအာရုံကြောစနစ်ကို စိတ်ကူးရယူကာ အပြန်အလှန်ချိတ်ဆက်ထားသော လမ်းဆုံအမှတ်များဖြင့် ဖွဲ့စည်းထားသည့် ကွန်ပျူတာတွက်ချက်မှုစနစ်သုံး AI မော်ဒယ်; modèle de calcul inspiré des neurones biologiques; kunstig etterligning av biologisk nervevev fra hjernen eller det sensoriske system; υπολογιστικό μοντέλο στην μορφή κυκλώματος διασυνδεδεμένων κόμβων (παρομοιάζοντας τους βιολογικούς νευρώνες) που χρησιμοποιείται στην επίλυση προβλημάτων στον χώρο της υπολογιστικής νοημοσύνης; математическая модель, построенная по принципу организации и функционирования биологических нейронных сетей; ankucha llika; Netz aus künstlichen Neuronen, das beim maschinellen Lernen eingesetzt wird; modelo computacional usado em aprendizagem de máquina, baseado em funções hierárquicas conectadas; paradigma d'aprenentatge i processament automàtic; հաշվողական մոդել, որն օգտագործվում է մեքենայական ուսուցման մեջ՝ հիմնված միացված, հիերարխիկ ֆունկցիաների վրա; 模仿生物神經網路結構和功能的數學模型或計算模型; computational model used in machine learning, based on connected, hierarchical functions; model computațional utilizat în învățarea automată, bazat pe funcții ierarhice conectate; 主に機械学習で用いられる、人間の脳神経を模したモデルの一種; modelo computacional usado em aprendizagem de máquina, baseado em funções hierárquicas conectadas; koneoppimisessa käytetty laskennanmalli; samlingsnamn på självlärande algoritmer som försöker efterlikna biologiska neuronnät; model obliczeniowy w uczeniu maszynowym oparty na funkcjach hierarchicznych; математична модель, побудована за принципом організації та функціонування біологічних нейронних мереж; modello matematico ispirato ai neuroni biologici; modelo computacional; מודל מתמטי חישובי; modello matematico inspiou da-e ræ neurale biològiche; 기계학습과 인지과학에서 생물학의 신경망에서 영감을 얻은 알고리즘; modelo computacional usado na aprendizaxe automática, baseado en funcións xerárquicas conectadas; mô hình toán học hay mô hình tính toán được xây dựng dựa trên các mạng neural sinh học; výpočetní model používaný ve strojovém učení; ierīce, kas paredzēta smadzeņu darbības modelēšanai; တုပအာရုံကြောကွန်ရက်; artificial neural network; neural network; လူလုပ်အာရုံကြောကွန်ရက်; နျူရယ်ကွန်ရက်; နျူရွန်ကွန်ရက်; redes neurales artificiales; redes fondes; rede neural simulada; rede neural estática; rede neural; XN; XNA; xarxa neuronal; KAL; Artiphisiyal ankucha llika; ANN; Ankucha llika; artificial neural networks; künstliche neuronale Netzwerke; líonra néarógach; شبکه‌های عصبی; 人工智慧网路; 類神經網路; 协同神经网络; 神经网络; 人工神经网络; neuralt netværk; rețea neuronală; sisteme conecționiste; Rețeaua Neurală Sinergetică; Reţeaua Neurală Statică; RNS; ニューラル・ネットワーク; ニューロ; ニューラルネット; 人工ニューラルネットワーク; 神経細胞網; ニューラルネットワークモデル; 神経回路網; רשת קישרית; 人工神經網路; 神經網路; न्यूरल नेटवर्क; ఏ ఎన్ ఎన్; ఆర్టీఫిషియల్ న్యూరల్ నెట్వర్క్; 인공신경망; neuronová síť; neuronové sítě; rete neurale; ANN; reti neurali; réseaux de neurones; réseau de neurones; reseau de neurones; réseau neuronique; réseau de neuronnes; artificial Neural Network; réseau de neurone; reseau de neurones artificiels; réseaux neuroniques; réseaux neuronaux; réseau neuronal; réseau de neurones artificiel; neuronal network; réseau neuronal artificiel; närvivõrk; mạng neural nhân tạo; ANN; artificial neural network; ANN; mākslīgie neironu tīkli; neironu tīkli (datorzinātne); Artificial neural network; неурална мрежа; umetno živčno omrežje; umetno nevralno omrežje; 神经网络; ANN; ԱՆՑ; ANN; neural network; connectionist system; connectionist systems; deep nets; Simulated Neural Network; Static Neural Network; SNN; Synergetic Neural Network; Neural Networks, Computer; neural net; artificial neural networks; NN; Neural network; ข่ายงานประสาทเทียม; เครือข่ายประสาทเทียม; Jaringan Syaraf Tiruan; Artificial Neural Network; kunstig nevralt nettverk; neuroniniai tinklai; neuroninis tinklas; rede neural; rede neuronal; rede neuronal artificial; нейронна мережа; штучні нейронні мережі; Redes Neuronales; Redes de neuronas; Redes Neurales; Redes neuronales artificiales; Neural Network; red neural artificial; 神经网络; RNAs; RNA; rede neural; الشبكات العصبونية الاصطناعية; شبكات عصبية اصطناعية; الشبكات العصبية الإصطناعية; شبكات عصبونيه اصطناعيه; الشبكات العصبية الاصطناعية; νευρωνικό δίκτυο; искусственные нейронные сети; нейросеть; искусственная нейросеть; ИНС; нейронная сеть</nowiki>

English: An artificial neural network (ANN) is an interconnected group of artificial neurons that uses a mathematical or computational model for information processing based on a connectionist approach to computation.

Structure

Neurons in artificial neural networks are generally structured in layers, each layer holding several neurons. This structure can be quite different.

Three different structures are shown here:

Neural network with one layer (without description).
Neural network with one layer (english description).
Neural network with one layer (German description).

Neural network with two layers (english description).

Neural network with one recurrent layer (without description).
Neural network with one recurrent layer (english description).
Neural network with one recurrent layer (German description).

Threshold outsourced as a bias neuron.

Neuron

A artificial neural network is build from several Neurons. A Neuron can be drawn in the following way:

Artificial neuron (without description).
Artificial neuron (english description).
Artificial neuron (German description).
Artificial neuron (French description).
Artificial neuron (without description).

Activation functions

Neurons can have different activation functions.

Three different functions are described here:

Hard limit function

A neuron with a hard limit function

$φ^{hlim} (v) = {\begin{matrix} 1 & for v \geq 0 \\ 0 & for v < 0 \end{matrix}$

Piecewise linear function

$φ^{pwl} (v) = {\begin{matrix} 1 & for v \geq \frac{1}{2} \\ v + \frac{1}{2} & for - \frac{1}{2} < v < \frac{1}{2} \\ 0 & for v \leq - \frac{1}{2} \end{matrix}$

Sigmoid function

A sigmoid function is also called a McCulloch-Pitts Model. can have a variable slope parameter $a$

$φ_{a}^{sig} (v) = \frac{1}{1 + \exp (- a v)} .$

Hard limit activation function.
Piecewise linear activation function.
Sigmoid function with slope $a = 5$ .
Radial base activation function.
Hyperbolic tangens activation function.

Specific types

Recurrent neural networks

Recurrent neural network (RNN) and its unfold version
A diagram for a one-unit Long Short-Term Memory (LSTM)
A diagram for a one-unit Gated Recurrent Unit (GRU)

Elman Networks

Elman Networks are special artificial neural networks which have a memory and thus are able to represent time in an implicit way.

Elman Network without description.
Elman Network with english description.
Elman Network with german description.

Time Delay Neural Networks

Time Delay Neural Networks (TDNNs) are special artificial neural networks which receive input over several time steps. Time is represented in an explicit way. The image shows an two-layer TDNN with neuron activations.

TDNN without description.
TDNN with english description.
TDNN with german description.