So in the code below, which is pretty standard LSTM training for the IMDB dataset, I have run extensive experiments where I changed the drop-out value from 0.5 all the way up to 1, and the accuracy on the test set is ALWAYS ~78%, never deviating by that very much. I even tried extremely low drop-out values, such as 0.2 and 0.1, and got the exact same result. Does anyone know why the accuracy of the trained model seems impervious to the drop-out rate? Going along with the same code, I then happened to tweak a few parameters: changed the learning rate from 0.001 to 0.005, and the batch size from 32 to 25, and NOW the drop-out values do have a large impact on the accuracy of the trained model. Again, why is that?     from __future__ import division,  print_function, absolute_import  import tflearn from tflearn.data_utils import to_categorical, pad_sequences from tflearn.datasets import imdb  # IMDB Dataset loading train, valid, test = imdb.load_data(     path='imdb.pkl', n_words=10000, valid_portion=0.1) trainX, trainY = train testX, testY = test validX, validY = valid  # Data preprocessing # Sequence padding trainX = pad_sequences(trainX, maxlen=100, value=0.) validX = pad_sequences(validX, maxlen=100, value=0.) testX = pad_sequences(testX, maxlen=100, value=0.)  # Converting labels to binary vectors trainY = to_categorical(trainY, nb_classes=2) validY = to_categorical(validY, nb_classes=2) testY = to_categorical(testY, nb_classes=2)  # Network building net = tflearn.input_data([None, 100]) net = tflearn.embedding(net, input_dim=10000, output_dim=128) net = tflearn.lstm(net, 128, dropout=0.1) net = tflearn.fully_connected(net, 2, activation='softmax') net = tflearn.regression(     net, optimizer='adam', learning_rate=0.001,     loss='categorical_crossentropy')  # Training model = tflearn.DNN(net, tensorboard_verbose=0) model.fit(trainX, trainY, n_epoch = 3,           validation_set=(validX, validY), show_metric=True,            batch_size=32)  score = model.evaluate(testX, testY) print('Test accuracy: %0.4f%%' % (score[0] * 100))
I'm training a neural network but the training loss doesn't decrease. How can I fix this?  I'm not asking about overfitting or regularization. I'm asking about how to solve the problem where my network's performance doesn't improve on the training set.    This question is intentionally general so that other questions about how to train a neural network can be closed as a duplicate of this one, with the attitude that "if you give a man a fish you feed him for a day, but if you teach a man to fish, you can feed him for the rest of his life." See this Meta thread for a discussion:   If your neural network does not generalize well, see:
I want to upgrade my Ubuntu 13.04 to Ubuntu 13.10. I'm unable to do via GUI.   [ The reason why I'm unable to do so:  Via software updater, I proceed ahead and click upgrade (for upgrading my OS). I authenticate by providing my password. Then it proceeds and downloads upgrade tool. That time only (while downloading the tool) error message comes "system program problem detected". It then doesn't proceed ahead and I click to report the problem ]  So, I tried via command line but here also I couldn't succeed upgrading my OS.  For the same I ran   $ sudo apt-get update   Then I ran  $ sudo apt-get dist-upgrade   And then:  ravbholua@ravbholua-Aspire-5315:~$ sudo do-release-upgrade Checking for a new Ubuntu release Get:1 Upgrade tool signature [198 B]                                                                                                  Get:2 Upgrade tool [1,135 kB]                                                                                                         Fetched 1,135 kB in 6s (32.9 kB/s)                                                                                                    authenticate 'saucy.tar.gz' against 'saucy.tar.gz.gpg'  gpg exited 2 Debug information:    gpg: Signature made Friday 01 November 2013 10:34:27 AM IST using DSA key ID 437D05B5 gpg: Can't check signature: public key not found  Authentication failed Authenticating the upgrade failed. There may be a problem with the network or with the server.  ravbholua@ravbholua-Aspire-5315:~$    Please suggest how to go ahead and upgrade my OS. As most of you know, in the Microsoft Store, there are . This means that on Windows I can emulate Ubuntu and have the Ubuntu command line directly on Windows.  The question is very easy: what can’t I do from the Ubuntu command line emulated in Windows that I can do on a proper Linux-based Ubuntu? Is it useful to download this Ubuntu application, install it, and work just with it instead of the real OS? Is it possible to install all the development libraries? Can I write (or not) device drivers? In other words: what are the limits?  What features of Ubuntu Linux-based are missing from Ubuntu-on-Windows?  New answers are welcome: I know that every software is always changing by improving characteristics and features! Proving a distance between molecules defines a metric space. A DNA molecule can be represented as a string of symbols $A$, $C$, $G$ and $T$, such as  $$GGATAATTCTAG. . .GACCGTACCC$$ For the purposes of this question, we will assume that all DNA molecules contain the same (large!) number $N$ of symbols. Thus, a DNA molecule is an $N$-tuple $x = (x_1, . . . , x_N)$ where $x_i  ∈ \{A,C,G,T\}$ for each $i$.  Define the distance between two DNA molecules $x$, $y$ as the number of elements $i ∈ {1, . . . ,N}$ such that $x_i \neq y_i$. Prove that this defines a metric on the set of DNA molecules. intuition on the fundamental group of $S^1$ I am familiar with the proof that the fundamental group of the unit circle $S^1$ is $\mathbb Z$, yet I couldn't develop intuition for why it is true. For example, why would I fail if I try to find homotopy from a path that circles $S^1$ once to the path that stays at one point all the time? What brakes the continuity of such a homotopy? Fallout Shelter :: Does Mr. Handy Pick Up Loot? I know that Mr. Handy will pick up caps when on walkabout; will he also pick up weapons and/or outfits? How do I see a C/C++ source file after preprocessing in Visual Studio? Cannot move file to trash warning when trying to delete a file in Nautilus I am trying to delete files in Nautilus and every time I try to delete one it always gives me this message:     Cannot move file to trash, do you want to delete immediately?   Then it gives me several questions. All I want is that when I press Delete in the keyboard, it sends it automatically to the trash can. Not to ask me every time.  The problem relates to NTFS partitions, external drives but also include Linux filesystems.  What are the reasons for nautilus beeing not able to move to trash? I have this question :  Proof if $f$ continuous in $x_0$ then there is a neighbourhood of $x_0$ so $f$ bounded.  I want to know if my proof is valid :  If continuous in $x_0$ then :  $$\lim_{x \to x_0} f(x)= f(x_0)$$  Therefore :  All $\epsilon&gt;0$ exists $\delta&gt;0$ so any $x$ that implies $|x-x_0|&lt;\delta$ implies $|f(x)-f(x_0)|&lt;\epsilon$.  Therefore for $\epsilon=1$ there is $\delta&gt;0$ so any $x$ that implies $|x-x_0|&lt;\delta$ implies $|f(x)-f(x_0)|&lt;1$.  $|x-x_0|&lt;\delta \rightarrow x_0-\delta&lt;x&lt;x_0+\delta$.  Lets choose $x_1,x_2$ that implies $x_0-\delta&lt;x_1&lt;x_2&lt;x_0+\delta$  Therefore in $[x_1,x_2]$ from Weierstrass from theorem bounded there. What are bitwise shift (bit-shift) operators and how do they work? I've been attempting to learn C in my spare time, and other languages (C#, Java, etc.) have the same concept (and often the same operators) ...   What I'm wondering is, at a core level, what does bit-shifting (&lt;&lt;, &gt;&gt;, &gt;&gt;&gt;) do, what problems can it help solve, and what gotchas lurk around the bend? In other words, an absolute beginner's guide to bit shifting in all its goodness. Expanding code in etoolbox's \ifblank I am trying to use the etoolbox \ifblank (and its cousin \notblank), but I want to expand any macros in its test statement.  For example:  \documentclass{article} \usepackage{etoolbox}  \begin{document}  \newtoggle{longformt} \newcommand{\longform}{\toggletrue{longformt}} \newcommand{\iflong}[2]{\iftoggle{longformt}{#1}{#2}}  \newcommand{\quoteifnotblank}[1]{%     \notblank{#1}{``#1''}{}% }  % Try commenting this line. \longform  This should be completely blank if the form is short: \quoteifnotblank{\iflong{Some long quoted text}{}}  \end{document}   The problem here is that \notblank sees its argument of \iflong{Some long quoted text}{} as a string, not as code to be expanded, so the quotes always appear.  How do I expand arguments before they are passed to \notblank? @class vs. #import It is to my understanding that one should use a forward-class declaration in the event ClassA needs to include a ClassB header, and ClassB needs to include a ClassA header to avoid any circular inclusions. I also understand that an #import is a simple ifndef so that an include only happens once.  My inquiry is this: When does one use #import and when does one use @class? Sometimes if I use a @class declaration, I see a common compiler warning such as the following:     warning: receiver 'FooController' is a forward class and corresponding @interface may not exist.   Would really love to understand this, versus just removing the @class forward-declaration and throwing an #import in to silence the warnings the compiler is giving me. I am trying to take pictures of large rugs. The rug size is about 10mx5m, and I'm  planning to purchase , and Canon 7D Mark II with Canon EF 50MM F/1.2L USM lens, since we need high quality images.  We want to set up a studio to take giga-pixel quality images of the large rugs for museum conservation purposes  Could you please suggest the best way for mounting the camera to the ceiling, and any other recommendations for my camera/lens setup, and required lighting? It will be  an indoor shoot. Just we want to setup a studio to shoot the large rugs. I have an Asus N76VB notebook with Ubuntu 14.04 and TLP for power managment. However, the fan is always on. It's not really loud, but it's annoying. My CPU usage is around 1-2%. It's clocked at 1.20 GHz.  I've added acpi=force to my boot parameters but it doesn't change anything.  /proc/acpi/fan: No such file or directory /proc/acpi/thermal_zone: No such file or directory   I've loaded all Asus ACPI modules.  lsmod | grep asus:  asus_nb_wmi            16990  0  asus_wmi               24191  1 asus_nb_wmi sparse_keymap          13948  1 asus_wmi video                  19476  2 i915,asus_wmi wmi                    19177  2 mxm_wmi,asus_wmi   Somehow, it can read the temperatures.  sensors:  acpitz-virtual-0 Adapter: Virtual device temp1:        +43.0°C  (crit = +108.0°C)  coretemp-isa-0000 Adapter: ISA adapter Physical id 0:  +44.0°C  (high = +87.0°C, crit = +105.0°C) Core 0:         +44.0°C  (high = +87.0°C, crit = +105.0°C) Core 1:         +42.0°C  (high = +87.0°C, crit = +105.0°C) Core 2:         +39.0°C  (high = +87.0°C, crit = +105.0°C) Core 3:         +39.0°C  (high = +87.0°C, crit = +105.0°C)  asus-isa-0000 Adapter: ISA adapter temp1:        +43.0°C     I really hope someone knows how to solve this. Almost all information I could find was about saving power to create less heat.    I got Intel and NVIDIA (GeForce 740M) graphics but I'm almost anytime on Intel.  $ sudo lshw -c display   *-display                       description: VGA compatible controller        product: 3rd Gen Core processor Graphics Controller        vendor: Intel Corporation        physical id: 2        bus info: pci@0000:00:02.0        version: 09        width: 64 bits        clock: 33MHz        capabilities: msi pm vga_controller bus_master cap_list rom        configuration: driver=i915 latency=0        resources: irq:43 memory:f7400000-f77fffff memory:d0000000-dfffffff ioport:f000(size=64)     fwts fan: I would like to align the view straight on to a face, perpendicular to the normal. How do I align the 3D viewport to the face of a mesh? Let $(a_n)$ be a strictly increasing sequence of positive integers such that: $a_2 = 2$, $a_{mn} = a_m a_n$ for $m, n$ relatively prime. Let $(a_n)$ be a strictly increasing sequence of positive integers such   that: $a_2 = 2$ and $a_{mn} = a_m a_n$ for $m, n$ relatively prime. Show that $a_n = n$, for every positive integer $n$.   This is a result apparently due to Paul Erdős, and  has a proof by induction.  I tried like this, $a_{10}=a_2a_5$. After this what we can do?    [Editor's comment] Possibly due to the apparent simplicity of the conditions it may be difficult to appreciate the subtleties of this question. If we try and construct a counterexample like $a_3=4$, $a_4=5$, $a_5=6$, then the requirements dictate $a_6=8$, $a_{10}=12$, $a_{15}=24$. At this point we realize that we have been speeding. For monotonicity forces $a_9\le 11$, and therefore $a_{18}\le22&lt;a_{15}$, violating the requirements. It is not obvious why something similar ruins all the modifications to the sequence $a_n=n$. [/comment, JL] Test if a website is alive from a C# application I am looking for the best way to test if a website is alive from a C# application. Background My application consists of a Winforms UI, a backend WCF service and a website to publish content to the UI and other consumers. To prevent the situation where the UI starts up and fails to work properly because of a missing WCF service or website being down I have added an app startup check to ensure that all everything is alive. The application is being written in C#, .NET 3.5, Visual Studio 2008 Current Solution Currently I am making a web request to a test page on the website that will inturn test the web site and then display a result. WebRequest request = WebRequest.Create(&quot;http://localhost/myContentSite/test.aspx&quot;); WebResponse response = request.GetResponse();  I am assuming that if there are no exceptions thown during this call then all is well and the UI can start. Question Is this the simplest, right way or is there some other sneaky call that I don't know about in C# or a better way to do it. Why isn't The Flash unstoppable? I've recently gotten into The Flash TV show, and so I've been reading about his powers. What I don't understand is why his typical rogues pose a threat - it seems like there should be very little limit to his powers.  He can go back in time, so if he loses a battle or the bad guys do something, he can go back and preempt it. In the new 52, he can all but predict the immediate future, so he can see bad things that are going to happen and stop them. He can phase matter through matter, or let matter pass through him. This means he is all but immune to weapons fire.  I haven't read enough of the old comics so I don't the know challenges he's had. For a guy who can't be attacked, can time-travel and can race around the globe several times in a minute, I can't imagine there is much that could pose a threat. How do I get a block with data to place myself? What does a dot after the file permission bits mean? I performed an ls -la on directory on my CentOS 6.4 server here and the permissions for a given file came out as:  -rwxr-xr-x.   I understand what -rwxr-xr-x means, what I don't understand is the . after the last attribute.  Can someone explain it to me? Is it harmful in any way? Can it be removed? Top Bar background does not persist when scrolling horizontally Update  A month Several months later, a new top bar, and the bug still exists. An answer has already been posted that would fix the bug, so is this something that the dev team plans on fixing?  There are also a host of other problems caused by this, especially on the  and . Again, this would be fixed with  html{min-width:1000px;}   There is a slight bug with small windows on both the new meta and main site(s)?, shown here. The problem is that the top bar coloring doesn't stretch across when you resize and scroll left or right.        On Meta, when a horizontal scroll bar is needed, the black background will only be as wide as the width of the viewport, but when you scroll the coloring will not shift.  To reproduce:   Make screen as large as possible, or wait until the menu bar starts expanding Make it smaller and smaller until horizontal scrollbar appears, then scroll left and right.