Showing posts with label birds. Show all posts
Showing posts with label birds. Show all posts

Wednesday, December 05, 2018

Fair Warning

If you ever want to enjoy a movie, radio show, or anything with bird sounds in the background, don’t ever learn bird calls and bird songs. I’ve said this before, either in discussion or maybe even somewhere on this blog. Actually, in counterpoint, when they get it right it really helps set the scene. If you want to start learning bird songs then try this Bird Academy class. Or if you are already somewhat experienced you could try the Quiz.


This quiz that I speak of is actually the project I have been working on the last three months. It is a quiz consisting of mostly unrated media, photo or audio, from the Macaulay Library archives, most of it contributed through ebird. I know it’s sort of like my child, but I absolutely adore it. I already took enough quizzes that I was mostly familiar with 80% of the birds in Japan in May…


I really would like to jump into the spaced repetition, but if as one of the rules in the link says you have to make your own cards, then it would be really hard for us to do with our random species and asset selection. It isn’t totally random, you can pick a place and a time of year. We get a list of likely birds seen in that part of the world, you will be disappointed with Barrow, Alaska in December, and then pick 20 random species. Then we get the photo or audio clip with the least number of ratings and serve up the quiz.


This works well for the most part for well inoculated users, there are terrible tiny photos and misidentified photos, but in general I really can’t get enough of it myself. There are a few issues that I think would make this a better experience for someone trying to use this to learn a new region: Weight the chance to see a species by the number of times you have seen it previously, and try to never show the same photo to the same user if it can be helped.




Let’s say that you are trying to learn birds of the Northeast US. One of them is most certainly the American Robin. At the moment in my area there are getting to be around 200 potential species. If you take the quiz 10 times and see 200 photos then you might have seen the good ol’ Robin about five or six times, and other species on an average of two or three.


This is a several runs of completely random choosing of species for quizzes. At 10 quizzes the user will only have seen 125 species of the 200. Even at 50 quizzes there are still 4 species the user has seen once, though because of long tails and randomness 40 quizzes should be a better indication at 13 species seen less than twice, or rather no chance to learn the species.


So totally random is not really a great way to go. On the other hand totally not random is an algorithmic nightmare unless handed over to Machine Learning or better: Machine Teaching. But let’s say we need a bit of middle ground. How about just calculating a weighted random selection that favors the species a user hasn’t seen yet? Basically every time the user sees a species, they are a bit less likely to see it. It isn’t a perfect solution, but it would be that much better.


This second approach shows a much steeper decline in the number of unseen species. The tail is still potentially long, but we have a much better chance of seeing more species over the course of fewer quizzes. We are only missing repetition for 57 species after 10 quizzes rather than 75 for the completely random approach. I know this doesn’t sound like much, but 20 species could be significant, especially if they are the most common species.

The second issue is a bit more tame. Essentially we are sorting the possible assets by how many ratings they have and then taking the most recent one with the least ratings. All we really need to do is get rid of the most recent and check for a user’s previous rating on a piece of media. It would take more time, but it could make it that much more rich. Really this is only a problem for species that have very few photos, so go take more! Maybe also unpopular bird species don’t get enough attention in that there isn’t enough turnover to churn-up the number of ratings on a regular basis. Hopefully will see less of the latter with more participants.


Why am I geeking out about this? Well it goes back to when my wife was studying birds for her two jobs doing bird surveys. She hand-built study decks and then reviewed them every night with Anki. Of course that fits in with the spaced repetition from before, but then I started working at the lab and saw how many photos we had, what a treasure trove to build something that could build a set of flashcards from 26k+ Robins, etc.! Starting this was like a dream come true, and through some not-so-dreamy work here we are. It needs some tweaking, but it is still superb.


***


I wrote this back in March before we released the app. The whole idea of the app is to help Macaulay Library to curate data via community ratings. Of course it is pretty close to being a learning app that people can learn birds with, but ML doesn’t want to step on toes. Nine months in we have collected 3 million ratings which helps us to show some of the best photos the community has taken. Ratings were critical in the release of eBird species pages where 6k previously un-curated species had photos and audio chosen if they had any.


I think the biggest wish now is to add a bit of filtering. For instance people might be well-versed in their finches, but want to focus on their shorebirds, even if you are birding locally. Currently with hundreds of species it could take quite a few quizzes to learn all of your shorebirds, though we would get quite a few ratings in the process. It is certainly a possibility, but we have plenty of projects to keep us busy, even for a good part of next year.

I've taken a few more since the start.


Wednesday, March 29, 2017

Another Attempt

Hairy Woodpecker taking off.

Or, I got really self-righteous writing an attempt at this post, or at least righteous.

So what am I doing now without two classes to keep up with? First, my wife is really happy that I am contributing more to chores. It is amazing how much she likes that, even with understanding just how much work school is. So if I don’t kill myself trying to do two classes maybe I can keep up more than just a token effort on chores.

And speaking of helping I was able to get her research back on track after five minutes of fiddling with the configuration files. It is nice that she can bother me without feeling guilty.

I really want to go fencing. This time for sure, no stopping me, we have all the gear.

More outdoor exercise, oh wait it dumped snow on us last week, just the walk to work was a workout. But the wife and I built a giant snow monster:

More birdwatching. Birds are coming to town! But it snowed and we’ve had some of the coldest weather of all winter. I am afraid that March regressed toward the mean, but it certainly didn’t mean that ski stores kept their supplies of skis in stock, I guess I’ve lived too close to real mountains to consider anything but mid-June to be the end of ski season.

Writing more: this, short stories, and my 2015 NaNoWriMo novel editing. Still learning. Blogging short stories has certainly not picked up a following at all. I need to be more consistent with those.

Learning Computer Vision. Wait, but didn’t I drop that class? Why yes, yes I did, but it doesn’t mean there aren’t resources like pyimagesearch.

3D-printing. It goes badly, two more failed prints, but I think I am having power issues because the power supply is so close to its limits. Fortunately I have an extra 500W supply just lying around from upgrading my desktop because it was right on the border too. With my electrical engineering knowledge I should be able to safely add the new supply, but we’ll definitely have to see.

And doing all these things I will still have time to spend with the wife, eat, and sleep. It isn’t weird how much time school takes up, but it certainly is a relief when it’s done.

Monday, October 17, 2016

The Lab of O

I’ve started the new job at the Cornell Lab of Ornithology! Specifically I am working for the Macaulay Library and it is awesome! When I started my previous job at COS I really wanted to push them to start supporting citizen science, but that never really worked out. Now I am dropped right in the middle of a citizen science and machine learning project! What could be better? If you want to help out: edbird is where you should submit checklists and upload photos, and merlinvision is where you can box/annotate bird photos.

So other than the tons of paperwork that comes with switching jobs, it is pretty awesome. My normal commute now is a walk in through the woods, with binoculars, so I can bird on the way in and out, and sometimes lunch too. It certainly beats 30 minutes each way unless I got stuck behind a bus.

Of course I am still learning the stack after two weeks (I claim there is quite a bit of paperwork to do), but I am starting to wrap my head around how things are done and being reminded how repetitive Java is: Make a new instance of a class by first telling the compiler that this is an instance of this class and then using “new” and the class… I understand that it makes it solid, near indestructible code, but I am not a huge fan. Also semicolons, thank goodness for a good development environment.

The best thing about this job is birds. People at work like birds! There are 1.4 million bird photos with more coming in every day from people across the world. It is just amazing that I am getting paid to do this. I guess they are paying me to become familiar with Java, the rest is just icing on the cake.

Wednesday, September 14, 2016

After Defeat


A bit lighter after the last post: After the robot competition my parents, in-laws, and my wife and I went to the New England Aquarium in Boston. It is quite an interesting building and just amazing how many different tanks they had. By the time we finished just before lunch the crowds of families pushing strollers was so pervasive that it was tough to move freely through the building. Still enjoyable.

We went back for a social for the teams, West Virginia was the only team to make any money out of the competition. I certainly envy them a bit, however, it is a large team (40+?) and most of the 750k is probably going to pay expenses and supplement a scholarship fund. They also had a bit of continuity having won 100k last year.

After the lunch the next day with Administrator Charles Bolden from NASA giving a speech, Jessie and I drove to Ithaca, NY. My In-laws also came with. Not too long of a drive from Worcester, but after a late lunch we arrived after dark. First impressions of the town it definitely seems like a nice town, but what I am really excited for is the Cornell Lab of Ornithology and its office.

We toured the office the next day, went on a walk around the pond, met a bunch of people, and saw where my desk is going to be. I was excited before the tour, I have always been a fan of the Lab, but I am much more excited about it now. Having my own desk with a window overlooking the pond, a much shorter commute for a while, people that might actually know how to drive in snow, and on and on…

Also when we mentioned Jessie’s Bachelor's senior thesis research to our guide and he followed up by talking to the Bio-acoustics Lab people and they are interested in talking to her! Even if she initially volunteers it will be nice to have her working across the hall rather than across the country.

So I can say that we are excited for the move, there are only three things that are varying levels of drawback to this move. The first and biggest drawback is that we have made friends in the area that actually think to invite us to do things. We had friends in Hawaii, but it seemed that they had mostly different interests, or just didn’t think about inviting us. So it will be difficult to make friends again, hopefully as nice too, right?

The second is just the process of moving, although we will be able to take much more with us initially because we don’t need to ship it across an ocean. More convenient if still just annoying how many things we have to deal with.

The third thing is about the Center for Open Science. Even though I am leaving I still want to see it succeed. Though I won’t miss the wash of panicked projects and the shifts in priorities that leave me wondering if I am actually contributing, it will be bittersweet. I plan to become an Ambassador and look into current processes with my new job to see if any part could use the OSF as it stands.

All in all bittersweet, but we, Jessie and I, are more mature, know most of what needs done, and are really excited. I'll
write about the new job in much more detail after I start.

Monday, September 12, 2016

Robots and Birds

Or: Why haven't I posted since January?

Quick answer, I said that finding objects in a photo should be easy. That was the end of December, by mid January I was on a team for the NASA Sample Return Robot Challenge. Needless to say it was a tougher project than originally thought. The competition was last week. I will post a post mortem about what I learned.

With that post I am also planning to start summarizing weeks with posts. Interesting things I did, new encounters, and what I learned.

Oh yeah, I also accepted a new job with Cornell Lab of Ornithology, specifically all the media coming in from ebird.org to Macaulay Library

And I just can't help but look at the next NASA challenge... Why?

Featured Post

Allergy

John studied himself in the mirror as best he could through tears. Red, puffy eyes stared back at him, a running nose already leaked just a ...