Explanation of the Noise Contrastive Estimation algorithm and clarification of terminology. Also covers InfoNCE, a popular technique in contrastive learning.
How does the ML research community feel about evolutionary algorithms? Should I do a PhD in this area? Quick remark: I know some people in the ML community dunk on evolutionary algorithms because there’s often a better optimizer, but they do have their place, which is what researchers in my community aim to quantify. Background: I just finished my first year as a mathematics master’s student working on the theory of evolutionary algorithms (EAs)/randomized search heuristics. I’m fortunate to be on a research assistantship and have already coauthored several papers in strong conferences in our area. I’ve always been more interested in classical ML/deep learning theory but haven’t had anyone to work with. Researchers in my field, including my advisor, occasionally publish in mainstream ML venues such as AAAI and NeurIPS, but it’s primarily the EA venues. For a while now, I’ve been independently studying deep learning and statistical learning theory, and I have found intersections with my current research that I plan to pursue for my thesis. With my current CV, it’s looking like I could get into some of the best PhD programs in my area, but I’m wondering if I should try to go to a more ML-centric PhD, even if it means going to a less prestigious institution/group for the sake of my career. I’m not sure yet what I want to do after my PhD and a possible postdoc, but I want to keep myself competitive for top-tier opportunities. What implications might doing an EA PhD have for my career? With strong EA publications, could I get into a good ML PhD program if I pitch myself appropriately? Could staying somewhat outside mainstream ML actually be a good career move, given how competitive and crowded ML has become? submitted by /u/NullRecurrentDad [link] [Kommentare]
Reviewing ArkType after writing about branded types and parsing in TypeScript. Turns out someone built the thing I was hand-rolling.
Argentina is considering legislation to allow AI-run companies with no human owners or executives. Supporters see innovation; critics warn of accountability risks.
On average, nearly eight cases of fraud in which money is stolen are reported in the UK every minute.
Hello everyone! I am trying to figure out if a main conference registration gives you access to the expo (companies booth) and the expo talks? Expo are happening on July 6th the same day as tutorials. But for tutorials you need to be registered. Do you also need to have a tutorial registration to be able to visit companies booth? Looked on the icml webpage but couldn’t find anything definitive( I did require a free expo badge when I registered ) Thanks submitted by /u/DazzlingPin3965 [link] [Kommentare]
