Friday, January 8, 2010

How does the size and number of layers effect back propagation neural networks?

I'm currently setting up a neural network to manage the learning of some rudimentary AI in a game I'm making. The network works by learning the responses of a large group of gamers from a test set of data. Having little Experience of programming neural networks, I was curious as to the effects of having more and bigger layers. Short of a longer execution time. Does it improve the accuracy sufficiently to warrant increasing the size?How does the size and number of layers effect back propagation neural networks?
Researchers have proved that you never need more than three layers (input, hidden, and output). In a very few cases, it may be more convenient to have four layers, but you should understand why you should have a fourth layer before you add it. So just stick with three.





Increasing the number of nodes does not necessarily improve accuracy and may even decrease it. Increasing the number of nodes also forces you to have a correspondingly larger training sample.





Here's an analogy: Generate a set of data points from the equation y = ax + b (choose whatever a and b you want, but keep them constant once you have chosen them). To each data point add some random noise. Now, fit a curve to your noisy data. The obvious answer is that the curve y = ax + b should fit the data set very well, despite the fact that you have added noise.





But if you wanted to, you could choose a high dimension polynomial, maybe something like y = ax^10 + bx^9 + cx^8 + dx^7 + ex^6 + fx^5 + g^x4 + hx^3 + ix^2 + jx + k. You could find a set of coefficients, a to k, that fit your data set better than the simple y = ax + b relationship. Should the 10th order polynomial therefore be used to model your data? No. Why? Because if you wanted to predict additional data values, the relationship y = ax + b will do a far more reliable job of prediction than the 10th order polynomial. It will produce very stable results, while the high order polynomial may predict wildly wrong answers, particularly when you have to extrapolate rather than interpolate.





The ultimate purpose for your neural net is to predict and, in a way, it is very much like a curve-fitting process. So by using a smaller number of nodes, you may have a poorer fit to your training data than a net with a larger number of nodes, but when it comes time to predict, the net with a smaller number of nodes will tend to be more stable and produce more realistic answers than the one with a large number of nodes.





When you go beyond the bounds of the training set - analogous to extrapolating the curve fit - a neural net with a large number of nodes is likely to be extremely unstable, where a much simpler net may produce much more reasonable answers.





If I recall correctly, the minimum number of training samples should be the product of the number of input nodes times the number of hidden nodes. You can always use more training samples, but never less. So as you increase the number of nodes, you dramatically increase the number of training samples required before you can start to get reasonable answers.
  • oil
  • skin facial
  • oil production
  • face creams
  • What is the best way to style medium length hair with a lot of layers and long bangs?

    i have brown hair. i am growing out my Straight bangs and i try to part them on the side. i have every appliance imaginable o i can do pretty much any thing. i really love formal looks.What is the best way to style medium length hair with a lot of layers and long bangs?
    uhm my hair sorta looks like yers and i just wear mine down and straight, er use a snap clip to hold my bangs up(:

    How can i layer clothes?

    can you help me with layering clothes and the colors and what stores i can get the right colors atHow can i layer clothes?
    you can layer with so so many things and the best thing about it is that if you layer then even if u wear the same clothes it luks completely different


    1.cami in black,white,grey,red,pink,purple,blue,gr鈥?or any other color you like


    2.lots of tanktops(all colors,plaid,checkered,etc...)


    3.cardigans buy a lot in a lot of colors becuz you can layer them with so many things





    try wetseal,pacsun,target,hollister,abercrom鈥?br>




    hope i helped=]How can i layer clothes?
    you dont need any specific clothes to layer.


    plain clothes or graphic tees or vests can work.





    when you layer, you want to have your underneath layers to show, so it has to be longer.





    ex. short sleeved shirt over long sleeved shirt over a long tank.


    or you can wear shirts with buttons and you can unbutton to show your tank or your under layer.
    just get plain tank top from any store and you can layer that under any shirt.

    In layering liquids, is it necessary to determine the solubility of all the liquids towards each other?

    Question above. : )





    Also, what is the best plan or procedure if you want to layer several liquids?In layering liquids, is it necessary to determine the solubility of all the liquids towards each other?
    That would depend on what you are trying to accomplish. If all you want to do is layer liquids, then the solubility of one in another shouldn't be of much concern. The plan would be to put the most dense liquid in the container first, followed by the next and the least dense placed on top.In layering liquids, is it necessary to determine the solubility of all the liquids towards each other?
    No, it's not - you can even layer several liquids on each other in case that they are soluble - you've never drinked the cocktail semaphore - absinthe, rum, griotte :) They are miscible, but will make layers, if poured very cautiously. You just need to pour slowly, and on the glass, instead of pouring it straight.





    You'll need to be patient, and train it for a while, but it's possible...

    How do I go about styling my layered hair?

    I have naturally curly hair and I use a straight iron to style it. But when I use it my hair never looks layered, it doesn't give it that dimension (the flat iron I mean). I also love how my hair looks after my stylist has blow dried it straight. But I can never get that look at home. I especially have blow drying it straight behind my head.





    So, how can I style my hair to accentuate the layers in it, and is there an easy way to blow dry it straight?How do I go about styling my layered hair?
    When you blowdry your hair, make sure that the blowdrier is pointed at the floor instead of directly at your hair, so it flattens your hair cuticles instead of ruffling them up, giving you a sleeker finish. Also, try ironing each layer individually--start with the layers close to your neck and work your way to the layers on top. This probably won't take much longer to do, and you'll get more of the layered look you want.


    Hope this helps!

    So if i layer this top will it just ruin it..?

    Okay so i got a really cute spagetti strap shirt today for back to school. the only problem is my school has a dress code policy and i cant wear it. So i was thinking..what if i wore just a plain, white solid tee under it? will it look weird?





    thank youSo if i layer this top will it just ruin it..?
    No, it wouldn't look weird at all, as long as has at least a little white in it.





    You could also try wearing a cardigan on cooler days.So if i layer this top will it just ruin it..?
    i agree with the others a nice cardigan would be nice


    or just a nice plain pink/blue/purple shirt


    and maybe a t-shirt with the sortof puffy sleeves on the shoulders


    id do that but im a bit to chunky for it and and makes me look weird


    :] but it's really cute if you can pull it off you know?
    Yes, I think it would look kind of weird. You should find some sort of cropped sweater to go over it. Like this:





    http://campussqueeze.com/wp-content/uplo鈥?/a>





    Something like that would look cute.


    One that matches your shirt, of course.
    wear another tank top under, but make sure its one with thicker straps, so its acceptable for school.


    wear it over a tank like this one:


    http://blog.roots.com/.a/6a00e553c41c918鈥?/a>
    it wont look weird people wear that all the time (:
    if you can pull it off, go for it.


    or try a cover up, or a zip up hoodie, cardigan or sweater!








    (: good luck
    Can you post a picture of it,


    or descrice it a little more please?
    no i think it is a really cute look! and it looks less sleezy too!
    yes it would look bad


    try wearing a cardigan!
    no, but a cardnigan over it would be much cuter:)
    how are we supposed to know if we don't know what it looks like?!

    How do you find out how many layers of coat your dog has?

    We are trying to narrow down some things about our mixed adopted dog. How can you tell how many layers your dog's coat has? What are you supposed to really look at?How do you find out how many layers of coat your dog has?
    Many breeds have a double coat which is composed of a harder, straighter top coat and a softer woolly undercoat.


    Using one finger, just gently push your dogs coat against the way it lies naturally. If he's double coated you should be able to see the softer coat lying nearer the skin.


    Double coated dogs tend to shed in 2 stages. First, the soft underocat comes out, often in clumps which you can pull out by hand once they have loosened, then the top coat somes out, more in individual hairs which fly all over the place and weave themselves into clothes and furnitureHow do you find out how many layers of coat your dog has?
    Some breeds gave what is called a double coat like the schnauzer which consists of an outer harsh coat and an undercoat that is much softer.This breed does not shed but most people who show have to remove the top coat and sometimes the dense undercoat so a new coat will grow.If you are Lucky and have what is called a natural coat you do not have to do the above but merely pluck out the longer hairs.As far as l know either a dog has a single or double coat.
    they can have several and with my husky i think he has over a100 lol.he has been shedding non stop all yr and i have clumps of hair and fur all over.he seems to have the top coat along with at least 3 under coats that are all falling out.the new growth pushed out the top and inbetween layers so its hard to pinpont how much ur pooch has. get a good grooming brush and use it on him weekly to remove all the loose fur and then the new growth will come in nice and soft.
    Take it to the vet and they can find out for you. It's probably pretty hard on your own.








    Abby
  • oil
  • skin facial
  • oil production
  • face creams
  •