Sequence Modeling with CTC

Posted in Uncategorized | Leave a comment

What is data science?

Yanir Seroussi

Data science has been a hot term in the past few years. Despite this fact (or perhaps because of it), it still seems like there isn’t a single unifying definition of data science. This post discusses my favourite definition.

Data Scientist (n.): Person who is better at statistics than any software engineer and better at software engineering than any statistician.

— Josh Wills (@josh_wills) May 3, 2012

One of my reasons for doing a PhD was wanting to do something more interesting than “vanilla” software engineering. When I was in the final stages of my PhD, I started going to meetups to see what’s changed in the world outside academia. Back then, I defined myself as a “software engineer with a research background”, which didn’t mean much to most people. My first post-PhD job ended up being a data scientist at a small startup. As soon as I changed my…

View original post 632 more words

Posted in Uncategorized | Leave a comment

Neural networks in a nutshell

The Men Who Stare at Codes

This is the first post that makes justice to the blog’s motto: show me the code motherfucker. In this and the next n posts with the title “Neural networks in a nutshell – k” I will talk about artificial neural networks, showing concepts (theory) and code (practice). The codes will be written in Python without any fancy library as NumPy, SciPy or PyBrain just because:

  1. I don’t know how to use any of these.
  2. I don’t have time to learn them now.
  3. The focus is in the concepts, not in the performance.

View original post 775 more words

Posted in Uncategorized | Leave a comment

246A, Notes 0: the complex numbers

What's new

Kronecker famously wrote, “God created the natural numbers; all else is the work of man”. The truth of this statement (literal or otherwise) is debatable; but one can certainly view the other standard number systems $latex {{bf Z}, {bf Q}, {bf R}, {bf C}}&fg=000000$ as (iterated) completions of the natural numbers $latex {{bf N}}&fg=000000$ in various senses. For instance:

  • The integers $latex {{bf Z}}&fg=000000$ are the additive completion of the natural numbers $latex {{bf N}}&fg=000000$ (the minimal additive group that contains a copy of $latex {{bf N}}&fg=000000$).
  • The rationals $latex {{bf Q}}&fg=000000$ are the multiplicative completion of the integers $latex {{bf Z}}&fg=000000$ (the minimal field that contains a copy of $latex {{bf Z}}&fg=000000$).
  • The reals $latex {{bf R}}&fg=000000$ are the metric completion of the rationals $latex {{bf Q}}&fg=000000$ (the minimal complete metric space that contains a copy of $latex {{bf Q}}&fg=000000$).
  • The complex numbers $latex {{bf C}}&fg=000000$ are the algebraic…

View original post 9,620 more words

Posted in Uncategorized | Leave a comment

IBM’s Big Data University: Free Online Learning With Over 400,000 Students – Forbes

It is widely forecasted that a shortage of skills in data science and analytics will mean a great deal of money is wasted through missed opportunities in coming years. Traditional academic establishments have begun to move to fill the gap. However, most courses teaching the hot topic skillsets such as […]

Sourced through from:

Great free content here:

Posted in | Leave a comment

Why there is no Hitchhiker’s Guide to Mathematics for Programmers

Math ∩ Programming

For those who aren’t regular readers: as a followup to this post, there are four posts detailing the basic four methods of proof, with intentions to detail some more advanced proof techniques in the future. You can find them on this blog’s primers page.

Do you really want to get better at mathematics?

Remember when you first learned how to program? I do. I spent two years experimenting with Java programs on my own in high school. Those two years collectively contain the worst and most embarrassing code I have ever written. My programs absolutely reeked of programming no-nos. Hundred-line functions and even thousand-line classes, magic numbers, unreachable blocks of code, ridiculous code comments, a complete disregard for sensible object orientation, negligence of nearly all logic, and type-coercion that would make your skin crawl. I committed every naive mistake in the book, and for all my obvious…

View original post 4,381 more words

Posted in Uncategorized | Leave a comment

Learning Programming — Finger-Painting and Killing Zombies

Math ∩ Programming

Zmob, my first (and only) original game.

By the end, the breadth and depth of our collective knowledge was far beyond what anyone could expect from any high school course in any subject. 

Education Versus Exploration

I’m a lab TA for an introductory Python programming course this semester, and it’s been…depressing. I remember my early days of programming, when the possibilities seemed endless and adding new features to my programs was exciting and gratifying, and I brimmed with pride at every detail, and I boasted to my friends of the amazing things I did, and I felt powerful. The world was literally at my fingertips. I could give substance to any idea I cared to entertain and any facet of life I wanted to explore. I had developed an insatiable thirst for programming that has lasted to this very day.

My younger self, if programming were more noodley.

The ironic thing is…

View original post 3,876 more words

Posted in Uncategorized | Leave a comment