
{"id":1749,"date":"2024-08-28T15:50:07","date_gmt":"2024-08-28T15:50:07","guid":{"rendered":"https:\/\/mycryptomania.com\/?p=1749"},"modified":"2024-08-28T15:50:07","modified_gmt":"2024-08-28T15:50:07","slug":"dimension-reduction-without-reducing-your-professional-integrity","status":"publish","type":"post","link":"https:\/\/mycryptomania.com\/?p=1749","title":{"rendered":"Dimension Reduction Without Reducing Your Professional Integrity"},"content":{"rendered":"<h3>The Unexpected Twist in a Prestigious Medical Research Firm Interview<\/h3>\n<p>Recently, I found myself at the final stage of a hiring process with a renowned medical research firm. Having received positive feedback in the earlier rounds, I was optimistic and eager to showcase my expertise. However, the final interview took an unexpected and challenging turn that left me re-evaluating the entire experience.<\/p>\n<p>The interviewer\u2019s demeanor was markedly different from what I had encountered previously, almost bordering on rude. He grilled me intensely about my career choices and past projects in biological research, with a critical tone that was hard to ignore. When I shared my experience with a liquid biopsy startup, the conversation quickly became highly technical. More details can be found<a href=\"https:\/\/medium.com\/python-in-plain-english\/saturate-your-data-science-expertise-a0998cd8caca\">\u00a0here<\/a>.<\/p>\n<p>An unsuccessful job interview<\/p>\n<p>I explained how we managed an overwhelming number of features through dimensional reduction using a process called saturation. The interviewer interrupted, questioning why we hadn\u2019t used Principal Component Analysis\u00a0(PCA).<\/p>\n<p>My honest response\u200a\u2014\u200athat PCA hadn\u2019t worked for us\u200a\u2014\u200awas met with skepticism. \u201cYou didn\u2019t use it properly,\u201d he asserted.<\/p>\n<p>To defend our approach, I highlighted the limitations of PCA in biological contexts. PCA essentially performs a general rotation of the data, functioning as a linear transformation that preserves both orientation and the Euclidean metric. However, this method is only valid when the data conforms to Euclidean principles, which is often not the case in biological systems.<\/p>\n<p><strong>PCA\u2019s Assumption of Euclidean Structure<\/strong><\/p>\n<p>PCA assumes that the data has an inherent Euclidean structure, a condition that is rarely met in biological systems. Biological data typically exhibit complex, non-Euclidean relationships that cannot be accurately represented by simple linear transformations.<\/p>\n<p><strong>The Issue with Linear Combinations<\/strong><\/p>\n<p>In biological contexts, linear combinations of variables often lack meaningful interpretation. For instance, what practical insight can be gained by adding twice the body temperature to three times the blood pressure level? Such combinations are abstract and fail to provide actionable information relevant to biological phenomena.<\/p>\n<p><strong>Non-linear Feedback\u00a0Loops<\/strong><\/p>\n<p>Many biological systems are characterized by non-linear feedback loops, which PCA is ill-equipped to capture. I used a saturation example to illustrate this: at low doses, there is little to no reaction, but beyond a specific threshold, saturation occurs, dramatically slowing the reaction rate. This behavior mirrors an activation function in neural networks, highlighting the data\u2019s inherent non-linearity. Accurately modeling these non-linear responses, such as enzyme kinetics or hormone levels, is essential for making reliable predictions.<\/p>\n<p><strong>Sensitivity to Non-linear Scaling<\/strong><\/p>\n<p>PCA is not invariant to non-linear scaling or changes in units. For example, a log transformation could significantly alter PCA results, leading to different interpretations.<\/p>\n<p><strong>Broader Implications<\/strong><\/p>\n<p>This non-linear behavior is not confined to a single scenario. Similar patterns emerge in studies of opioid dosages, insulin response, and other pharmacokinetic phenomena. For instance, the relationship between drug dosage and effect is rarely linear, underscoring the importance of understanding these nuances for effective treatment planning.<\/p>\n<p>It is worth noting that other metrics, such as the Manhattan or maximal metrics, do not allow for geometrical interpretation. This is because they are not derived from any inner product, which is necessary for defining an angle between two\u00a0vectors.<\/p>\n<p>To my surprise, my detailed explanation fell flat. The interviewer retorted, \u201cI see your point, but I know that linear methods are working all across biology. I\u2019d rather hire a mathematician who can explain why it works, not why it doesn\u2019t.\u201d<\/p>\n<p>Needless to say, I didn\u2019t get the job. While disappointed, I left feeling confident in my answers. If my honest, scientifically grounded perspective wasn\u2019t appreciated, perhaps this wasn\u2019t the right fit for me after\u00a0all.<\/p>\n<p>This experience taught me a valuable lesson: interviews aren\u2019t just about showcasing your knowledge but also about aligning with the company\u2019s methodologies and perspectives. While it\u2019s crucial to stand by your expertise, it\u2019s equally important to gauge the receptiveness of your audience. In this case, the interviewer\u2019s rigid adherence to traditional methods overshadowed the opportunity for an innovative approach to complex biological data.<\/p>\n<p>Reflecting on the interview, I realized the importance of finding a workplace that values critical thinking and the ability to challenge established norms when necessary. The right opportunity should not only appreciate my technical skills but also my willingness to think outside the box and apply unconventional solutions to unique problems.<\/p>\n<p>In the end, not getting this job might have been a blessing in disguise. It\u2019s a reminder that the right fit is not just about the prestige of the firm but also about mutual respect and a shared vision for innovation and progress. Moving forward, I\u2019ll be more mindful of aligning with organizations that value a holistic and open-minded approach to problem-solving in the ever-evolving field of biological research.<\/p>\n<p><a href=\"https:\/\/medium.com\/coinmonks\/dimension-reduction-without-reducing-your-professional-integrity-dffa3830f4b6\">Dimension Reduction Without Reducing Your Professional Integrity<\/a> was originally published in <a href=\"https:\/\/medium.com\/coinmonks\">Coinmonks<\/a> on Medium, where people are continuing the conversation by highlighting and responding to this story.<\/p>","protected":false},"excerpt":{"rendered":"<p>The Unexpected Twist in a Prestigious Medical Research Firm Interview Recently, I found myself at the final stage of a hiring process with a renowned medical research firm. Having received positive feedback in the earlier rounds, I was optimistic and eager to showcase my expertise. However, the final interview took an unexpected and challenging turn [&hellip;]<\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[],"class_list":["post-1749","post","type-post","status-publish","format-standard","hentry","category-interesting"],"_links":{"self":[{"href":"https:\/\/mycryptomania.com\/index.php?rest_route=\/wp\/v2\/posts\/1749"}],"collection":[{"href":"https:\/\/mycryptomania.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mycryptomania.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/mycryptomania.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1749"}],"version-history":[{"count":0,"href":"https:\/\/mycryptomania.com\/index.php?rest_route=\/wp\/v2\/posts\/1749\/revisions"}],"wp:attachment":[{"href":"https:\/\/mycryptomania.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1749"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mycryptomania.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1749"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mycryptomania.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1749"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}